Selasa, 02 Januari 2018

Unit 10



Principles of effective materials development & Materials evaluation 




Principles of Materials Development
  • Make sure that the materials contain a lot of spoken and written texts which provide extensive experience of language being used in order to achieve outcomes in a variety of text types and genres in relation to topics, themes, events, locations etc likely to be meaningful to the target learners.
  •   Make sure that the language the learners are exposed to is authentic in the sense that it represents how the language is typically used. If the language is inauthentic because it has been written or reduced to exemplify a particular language feature then the learners will not acquire the ability to use the language typically or effectively.Much has been written on the issue of authenticity and some experts consider that it is useful to focus attention on a feature of a language by removing distracting            difficulties and complexities from sample texts. My position is that such contrived focus might be of some value as an additional aid to help the learner to focus on salient features but that prior and subsequent exposure to those features in authentic use is essential. 
  •   Make sure that the language input is contextualised. Language use is determined and interpreted in relation to its context of use. De-contextualised examples do not contain enough information about the user, the addressee(s), the relationships between the interactants, the setting, the intentions or the outcomes for them to be of value to the language learner. I can, for example, think of at least three different interpretations of, “Give him the keys. Let him drive it.” But I do not know what it really means nor why the speaker has used the imperative until I know who is saying it, who they are    saying it to, what the relationship between them is, where they are, what has happened before and what the objectives of the conversation are. Only extended samples of language in contextualised use can provide learners with the ‘information’ they need to develop awareness of how the target language is actually used.
  • Make sure that the learners are exposed to sufficient samples of language in authentic use to provide natural re-cycling of language items and features which might be useful for the learners to acquire.



MATERIALS EVALUATION

As defined by the American Evaluation Association, evaluation involves assessing the strengths and weaknesses of programs, policies, personnel,products, and organizations to improve their effectiveness.Evaluation is the systematic collection and analysis of data needed to make decisions, a process in which most well-run programs engage from the outset.Here are just some of the evaluation activities that are already likely to be incorporated into many programs or that can be added easily:


  • Pinpointing the services needed for example, finding out what knowledge,skills, attitudes, or behaviors a program should address



  • Establishing program objectives and deciding the particular evidence (such as the specific knowledge, attitudes, or behavior) that will demonstrate that the objectives have been met. A key to successful evaluation is a set of clear, measurable, and realistic program objectives. If objectives are unrealistically optimistic or are not measurable, the program may not be able to demonstrate that it has been successful even if it has done a good job.Developing or selecting from among alternative program approaches for example, trying different curricula or policies and determining which ones best achieve the goals.

  • Tracking program objectives for example, setting up a system that shows who gets services, how much service is delivered, how participants rate the services they receive, and which approaches are most readily adopted by staff 

  • Trying out and assessing new program designs determining the extent to which a particular approach is being implemented faithfully by school or agency personnel or the extent to which it attracts or retains participants.Through these types of activities, those who provide or administer services determine what to offer and how well they are offering those services.In addition, evaluation in education can identify program effects, helping staff and others to find out whether their programs have an impact on participants 'knowledge or attitudes.


Process Evaluations
       Process Evaluations describe and assess program materials and activities. Examination of materials is likely to occur while program are being developed, as a check on the appropriateness of the approach and procedures that will be used in the program. For example, program staff mighty stematically review the units in a curriculum to determine whether they adequately address all of the behaviors the program seeks to influence. A program administrator might observe teachers using the program and write a descriptive account of how students respond, then provide feedback to instructors. Examining the implementation of program activities is an important form of process evaluation. Implementation analysis document swhat actually transpires in a program and how closely it resembles the program's goals. Establishing the extent and nature of program implementation is also an important first step in studying program outcomes;that is, it describes the interventions to which any findings about outcomes may be attributed. Outcome evaluation assesses program achievements and effects.

Outcome Evaluations
        Outcome Evaluations study the immediate or direct effects of the program on participants. For example, when a 10-session program aimed at teaching refusal skills is completed, can the participants demonstrate the skills successfully? This type of evaluation is not unlike what happens when a teacher administers a test before and after a unit to make sure the students have learned the material. The scope of an outcome evaluation can extend beyond knowledge or attitudes, however, to examine the immediate behavioral effects of programs.

Impact Evaluations
        Impact Evaluations look beyond the immediate results of policies,instruction, or services to identify longer-term as well as unintended program effects. It may also examine what happens when several programs operate in unison. For example, an impact evaluation might examine whether a program's immediate positive effects on behavior were sustained over time.Some school districts and community agencies may limit their inquiry to process evaluation. Others may have the interest and the resources to pursue an examination of whether their activities are affecting participants and others in a positive manner (outcome or impact evaluation). The choices should be made based upon local needs, resources, and requirements.Regardless of the kind of evaluation, all evaluations use data collected in a systematic manner. These data may be quantitative such as counts of  program participants, amounts of counseling or other services received, or incidence of a specific behavior. They also may be qualitative such as descriptions of what transpired at a series of counseling sessions or an expert's best judgment of the age-appropriateness of a skills training curriculum.Successful evaluations often blend quantitative and qualitative data collection.The choice of which to use should be made with an understanding that there is usually more than one way to answer any given question.
 
Why Do Evaluation?
          Evaluations serve many purposes. Before assessing a program, it is critical to consider who is most likely to need and use the information that will be obtained and for what purposes.Listed below are some of the most common reasons to conduct evaluations. These reasons cut across the three types of evaluation just mentioned. The degree to which the perspectives of the most important potential users are incorporated into an evaluation design will determine the usefulness of the effort.There are two types of materials evaluation : a predictive evaluation designed to make a decision regarding what materials to use, and a retrospective evaluation designed to examine materials to use, and a retrospective evaluation designed to examine materials that have actually been used. Retrospective evaluations can be impressionistic or empirical.It is suggested that one way in which teachers can conduct empirical evaluations isbyinvestigating specific teaching tasks.

0 komentar:

Posting Komentar