Thursday, 30 March 2023

How To Evaluate and Assess Students for English Listening and Speaking?

 Framework Proposal

Conduction of English Listening and Speaking Assessments

All Level Students

 

Introduction:

English is the language of international communication, and it has become a necessity to have proficiency in English in almost all fields of life, including education, business, and social interactions. In non-native set-ups, where English is not the first language, it is essential to have an effective system of English language assessment for students at the secondary and higher secondary levels. This proposal outlines a framework for conducting English Listening and Speaking assessments for SSC and HSSC level students in a non-native set-up.

Objective:

The primary objective of this framework is to develop a reliable, valid, and efficient system of English Listening and Speaking assessment for SSC and HSSC level students in a non-native set-up. The framework aims to provide clear and measurable outcomes of English proficiency levels and to identify students' strengths and weaknesses in Listening and Speaking skills.

Framework Components:

1.      Assessment Tools:

a. Audio Files: Recordings of English conversations, speeches, lectures, and interviews.

b. Speaking Prompt Cards: Prompts for students to speak on different topics, including general topics and academic subjects.

c. Scoring Rubrics: A set of criteria for scoring students' Listening and Speaking performances.

2.      Assessment Procedures:

a. Test Administration: Tests will be administered in a controlled environment, such as a classroom or a language lab.

b. Test Format: The Listening and Speaking tests will be administered separately.

c. Test Length: The Listening and Speaking tests will be of 30 minutes each.

d. Test Scoring: Scoring of the tests will be done according to the scoring rubrics.

e. Test Results: Results of the tests will be shared with the students, parents, and school administration.

3.      Assessment Standards:

a. Common European Framework of Reference for Languages (CEFR) levels will be used as assessment standards.

b. CEFR levels will be converted into a scale of 0-100 to provide a clearer indication of students' English proficiency levels.

Standard Operating Procedures (SOPs):

1.      Pre-Test Procedures: 

    a. Audio Files will be selected and checked for quality and content. 

    b. Speaking Prompt Cards will be created according to the student's proficiency 

        levels and academic requirements. 

    c. Scoring Rubrics will be developed and tested for reliability and validity. 

    d. Students will be briefed about the test format and scoring criteria.

2.      Test Administration Procedures: 

    a. Test Environment will be set up, ensuring a quiet and distraction-free                   

        environment. 

    b. Test Takers will be provided with instructions and guidance for the tests. 

    c. The Listening Test will be played through speakers or headphones. 

    d. The Speaking Test will be conducted individually, and each student will be 

        recorded for scoring purposes.

3.      Post-Test Procedures: 

    a. Audio Files and Speaking Test Recordings will be collected and stored securely. 

    b. Scoring will be done by trained and certified assessors using the Scoring Rubrics. 

    c. Results will be calculated, and students will be informed about their proficiency 

        levels. 

    d. A report will be generated, including students' proficiency levels, strengths, and 

    weaknesses.

This proposed framework provides a comprehensive and efficient system of English Listening and Speaking assessments for all level students in a non-native set-up. The use of CEFR levels and a standardized scoring rubric ensures a reliable and valid assessment of students' English proficiency levels. The framework's implementation will provide students, parents, and schools with a clear understanding of students' English language skills and will help in identifying areas for improvement.

Sample Listening Test:

Instructions: Listen to the recording carefully and answer the questions below.

Recording:                                     

Here is a short conversation between a customer and a sales representative at a phone store.

Sales Representative: Good afternoon, how can I help you?

Customer: Hi, I'm looking for a new phone. What do you recommend?

Sales Representative: Well, we have a range of phones with different features. Are you looking for a specific brand or operating system?

Customer: Not really, I just want a phone with a good camera and long battery life.

Sales Representative: Okay, then I would recommend the Samsung Galaxy S20. It has a great camera and a long-lasting battery. Would you like to take a look?

Customer: Yes, please. Thank you.

Questions:

1.      What is the purpose of the conversation?

2.      What is the customer looking for in a phone?

3.      Which phone does the sales representative recommend?

Sample Speaking Test:

Instructions: Choose one of the prompts below and speak on the topic for 2-3 minutes. The speaking will be recorded for scoring purposes.

Prompts:

1.      Talk about your favorite hobby and why you enjoy it.

2.      Describe your favorite place to visit and why it is special to you.

3.      Discuss a social issue that you are passionate about and why it matters to you.

Scoring Rubric:

The speaking test will be scored on the following criteria:

·         Pronunciation: clear and accurate pronunciation of English sounds

·         Vocabulary: appropriate use of vocabulary and expressions related to the topic

·         Grammar: correct use of grammatical structures and tenses

·         Fluency: the smooth and natural flow of speech without hesitation or repetition

·         Coherence: logical and organized presentation of ideas

Note: The scoring rubric may be adapted or modified depending on the specific requirements of the assessment.

Listening Test SOPs:

1.      Test Environment: Ensure a quiet and distraction-free environment for the test takers. Make sure that the test room has good acoustics and appropriate audio equipment for the listening exercises.

2.      Test Materials: Prepare the listening test materials beforehand, including audio recordings and test questions. Ensure that the audio quality is clear and audible.

3.      Test Administration: Provide clear instructions to the test takers regarding the listening exercises. Make sure that the instructions are standardized and consistent for all test takers.

4.      Test Scoring: Use the established listening test rubric to score the responses of the test takers. Ensure that the scoring is objective and consistent for all test takers.

5.      Test Result Reporting: Compile the test scores and provide feedback to the test takers. Ensure that the results are communicated in a clear and understandable manner.

Listening Test Scoring Rubric:


Speaking Test SOPs:

1.      Test Environment: Ensure a quiet and distraction-free environment for the test takers. Make sure that the test room has appropriate audio recording equipment and other necessary resources for the speaking exercises.

2.      Test Materials: Prepare the speaking test prompts beforehand. Ensure that the prompts are relevant and appropriate for the level of the test takers.

3.      Test Administration: Provide clear instructions to the test takers regarding the speaking exercises. Ensure that the instructions are standardized and consistent for all test takers.

4.      Test Scoring: Use the established speaking test rubric to score the responses of the test takers. Ensure that the scoring is objective and consistent for all test takers.

5.      Test Result Reporting: Compile the test scores and provide feedback to the test takers. Ensure that the results are communicated clearly and understandably.

In conclusion, by following the proposed framework, SOPs, and test tools, it is possible to conduct English Listening and Speaking assessments for all level students in a non-native set-up in a standardized and reliable manner.

Speaking Test Scoring Rubric:



Note: The rubrics are for illustrative purposes only and can be modified or adapted as per specific requirements.