Technologically and linguistically adventurous EFL teacher, trainer, writer and manager

Posts tagged ‘testing’

Testing times

This is my penultimate post in this series of weekly reflections on the current goings-on, as I finish with my groups next week. This week my two lessons were both tests: the first was reading and listening, the second speaking. In this post, I’ll describe how we ran the tests and what I’ve learnt about Zoom this week.

Before I start, I’d like to stress that systems we’ve been using to test our students are the cumulative thought process and reflection on experience of the teachers and management team I work with at IH Bydgoszcz, and we’re refining it all the time! Thank you to my colleagues for all of their input and feedback!

Testing listening and reading

Before the lesson:

  • Create a Google Doc with your questions. Check that these are relatively easy to complete on a computer even if you have minimal technical skills, particularly for the listening.
  • Make one copy per student, with the student’s name in the file name, plus a demo document.
  • Create an extra document. In this document, make a list of all of your students’ names, with the edit link for the document under their name. Leave a space after each name/link pair. This makes things easier during the lesson!

During the lesson:

  • Have all of the students’ listening or reading tests open in a single set of tabs.
  • Remind them to put all phones, books etc, away from their device (unless they’re using a phone of course!)
  • For reading, tell them that you would like to check their reading, not Google’s, and therefore they shouldn’t copy and paste the text or any of the questions (this happened in a couple of my colleagues’ lessons!)
  • Show students the demo document, particularly any question types/exercise types which they might not immediately be able to work out how to complete. This includes how you want them to complete e.g. a True/False question. Should they underline it? Highlight it? Delete one? The last is probably the easiest by the way!
  • Put the list of links into the chat box. Students click on their link. If students aren’t logged in to Google (they don’t need to be), you should see a little coloured circle in the top right corner saying ‘anonymous wombat/ifrit/walrus’ etc appear when they’re in.
  • Ask students to type their name at the top of the document when they get in. This helps you to check that the right student is in the right document. Go through each test and check it matches the file name.
  • Ask everybody to mute their microphones. Mute yours too.
  • For listening, tell students that if they can’t hear or there’s a problem with the audio, they should say ‘Stop, help!’ as soon as possible. One or two colleagues had students who got to the end before saying they couldn’t hear anything!
  • Start the listening – make sure you’re sharing your computer audio! It’s best to have the file on your desktop, rather than streaming it, if possible.
  • While the students are completing the reading or listening, flick through the documents to see whether they’re filling it in correctly, as in completing the tasks in the way you want them to. Help students if they’re having problems. Create a manual breakout room to move a student to if you need to speak to them.

If you suspect cheating, you can look at previous versions of the document to see how the student completed it by checking how they edited it over time.

Testing speaking

We had some lessons where the teaching did the testing, and others where there was a guest examiner. In all cases, the students worked in pairs in breakout rooms on a revision activity throughout the lesson. Mostly this was them creating a game, and they then switched games with other students to play in the second half of the lesson. I saw various types of game:

  • Creating a Kahoot.
  • Creating virtual board games in Google Docs or using Tools for Educators. Thanks to Ruth Walpole for leading me to that website.
  • Completing a list of challenges which each have points values, with the aim of getting as many points as possible.

The teacher set up the main activity at the start of the lesson, then put students into breakout rooms. The speaking examiner dropped in to each breakout room to test the students, then moved onto the next room. If it was a guest examiner, they could put up their hand so that the teacher knew it was time to move them to the next room. This system seemed to work pretty well. 🙂

The personal stuff

Things seem to be returning to some level of normality here in Poland. You no longer have to wear masks outside, though I still generally do, apart from when I’ve been on my bike far away from other people. It’s almost like nothing happened in many ways, which seems quite strange!

Useful links

Edutopia has an article about how to reduce the likelihood of teacher burnout during the pandemic, as a lot of us seem to be working a lot more hours now (though luckily mine are pretty similar).

I’ve listened to three episodes of TEFL Commute Who’s Zooming Who? this week: Realia, Guests and PowerPoint, all full of useful ideas. Find the full back catalogue here.

Anka Zapart has great ideas for teaching YLs on her Funky Socks and Dragons blog. Here’s a whole list of ways to work with songs, both online and off.

Alex Case has materials for teaching language for checking and clarifying on Zoom, something we all need!

James Egerton has a range of tips and activities for teaching on Zoom in this blogpost.

David Petrie is blogging again 🙂 Here’s his reflection on blogging and teaching in the time of COVID-19.

Jacqueline Douglas talks about all the things she’s noticed about running CELTA online.

THE REST OF THE SERIES

Each week I’ve summarised what our teachers and I have learnt during the transition to online teaching. Every post includes some tips about using Zoom, activities we’ve tried out (many adapted from the face-to-face classroom), and reflections on how my teaching and management have been affected by working from home. Here are all of the posts so far:

You may also find some other posts on my blog/which I’ve written useful:

Stay healthy. Stay safe. Stay kind. And stay at home (if you still have to!)

IATEFL 2018: Our developing profession

This blog post collects together a few ideas that look at how English as a Foreign Language has changed as a profession over the years, for better and worse.

Barry O’Sullivan’s closing plenary looked at the history of the testing industry. I found the overview fascinating, not having realised quite how recently testing became such big business, or the incremental changes that have gone into shaping it. You can watch the full plenary here.

I felt independent publishers were much more prominent at this IATEFL conference than in previous years, with their stand right in the centre of the exhibition. The stand featured EFL Talks, Alphabet Publishing, Wayzgoose Press (run by Dorothy Zemach – see below), PronPack, The No Project, Transform ELT, and I was able to advertise ELT Playbook 1 there too. (Apologies if I’ve forgotten anyone!)

ELT Playbook 1 cover

My main presentation was introducing ELT Playbook 1, which I self-published. I was pleased to be able to talk to so many people about it and get feedback on my idea throughout the conference. If you have missed my advertising it all over this blog 🙂 and don’t know what I’m talking about, it’s an ebook designed for new teachers, supporting them with questions to aid reflection, along with suggestions of ways to record their reflections, and option to join in with an online community and get support from others. It’s also suitable for trainers or managers who would like help with supporting their teachers. I’m aiming for it to be the first in a series, so watch this space for later entries. You can find out more information, including how to buy it, on the ELT Playbook blog. Mike Harrison and Shay Coyne both attended and sketchnoted the talk – thank you!

As well as books you pay for, like mine :), there were also a range of free titles advertised, all designed to advance our profession. These included:

The visibility and importance of independent publishers was helped by Dorothy Zemach’s plenary, ‘Sausage and the law: how textbooks are made’. It was one of the highlights of the conference for me. You can see responses by Helen Legge in this tweet:

and by Steve Brown in this blogpost. Emma-Louise Pratt, the conference artist, responded to the talk visually during the conference, which I thought was an interesting addition to the event this year.

You can watch the full plenary yourself here, as well as watching Dorothy talking after the plenary here:

Here’s my summary (though you should watch the talk yourself!):

Students’ books used to be the component of coursebooks which made all the money, with teachers’ books given away for free. They were basically just an answer key. Now publishers still try to make money on the students’ books, but there are a huge range of other possible components. There is also more copying and piracy of components, as well as old editions being used for longer and teacher-made materials replacing the books.

The combination of these factors mean that profits fall, so the price of books has risen, making them harder to afford, meaning there is even more copying, and so on. This, in turn, means that there is less money to pay the writers, especially as publishers have moved from a royalty system to a fee system, so authors find it harder to make a living. They also are less likely to care as much about the project, become reluctant to market the book, and quit, or they just don’t propose the innovative ideas they might have in the past.

The knock-on effect of all that is that experienced writers leave the profession, and less experienced writers fill the gap as they cost publishers less money. There are also more non-educators in other parts of the publishing process, meaning that the quality of projects drops. The whole process involves more work for everyone, as these writers need more support. Writers are also far more likely to be doing this work in addition to another job. Dorothy included a quote from Michael Swan summarizing the problem with writing on the side, rather than full-time:

To expect the average working teacher, however gifted, to write a viable general language course is like expecting the first violinist to compose the whole of the orchestra’s repertoire in his or her evenings off.

Dorothy also talked about the amount of money an author might (not) make from a book put together by a publisher versus a self-published book. She mentioned that digital was blamed for the drop in revenue from books, but as she said, if digital is losing you money, you’re doing it wrong! Technology should be making things easier and cheaper, not harder and more inaccessible.

In a nutshell, Dorothy’s plenary explained exactly why I decided to self-publish ELT Playbook 1: my ideas, my control, my timescales, my responsibility, my money.

So what can we do? Evaluate materials critically, compare and contrast them, keeping your learners’ needs in mind. Give feedback to publishers, push them when they don’t want to include particular things, up to and including the name(s) of the author(s) on the cover. If you love a book, tell publisher what they’re doing right. Pay attention to the content, trust authors to defend the pedagogy of their work, and remember that nobody wants to put together a bad product, because it just won’t make money. Most importantly

PAY FOR YOUR STUFF.

If you can’t afford something, don’t copy it or download it illegally, choose something else. The more often you refuse to pay, the more expensive things are likely to become. Piracy is not a victimless crime. If we don’t pay, people can’t earn a living, and we all suffer.

As Dorothy said, good writing is hard. It shouldn’t be us and them. It should be us, all together in education.

Amen.

I am *super* impressed! (guest post)

This post appeared in my facebook news feed yesterday, and I immediately asked if Tereza would let me share it on my blog. In it, she questions the value of positive feedback.

Today I received my evaluation of the final project in my sports class and it motivated me for a little contemplation on one of the differences between American and Czech (or even European in this respect) culture. The task was to create my own workout and lead my classmates for the fraction of the lecture. Eventually, due to time reasons, it was ONLY 5 MINUTES. So basically, all I did was I came up with 6 exercises, explained and demonstrated them to my classmates and then we performed them for 40s each with 5s break in between. The whole time I commented into the microphone like ’15 seconds, almost there, you can do it!’ because that was one of the requirements. You can see my evaluation below. My teacher was SUPER impressed, I looked like a professional, I should be an instructor.

Tereza's feedback

Tereza’s feedback

And here comes my point – really? I did not do anything impressive, I have never led a sport lecture before so I definitely have no motivation or other techniques developed and yet, based on 5 mins of doing stuff we have been doing in almost every class this semester, I should be an instructor! Americans are just always mega super trooper supportive to students, to kids, to each other, to everyone. Whatever you do, no matter how good or bad, it’s amazing. If you ask a question, however dumb one, teachers always start their answer with ‘That was an excellent question! I’m so glad you’re asking that.’ Whatever you do, it’s awesome, whatever you say, it’s so smart, whatever you wear, it looks cute and wonderful on you. One might think that there is everything perfect in America and everybody is talented and smart here. And that’s exactly mine (and not just mine) observation – people here really do think that. People are convinced that they are all brilliant at everything they do and look great in everything they wear. This might be a too big generalization, I admit. However, I can see evidence that it is mostly true every day.

My boyfriend teaches a calculus class at university in Missouri and his students, all future engineers by the way, are used to being praised their whole lives, getting excellent grades for everything and being told they can do everything and they are the best and the like as you could see on my evaluation. So those students are all shocked when they don’t get partial credit for accidentally guessing the right result, they are all surprised that there is someone who wants them to work hard for excellent grades and does not tell them ‘great job’ if the job is actually not that great. Instead of feeling ashamed they did not learn something or did not do the homework and therefore could not solve some exam problems, they go to him to complain, to accuse him that it is actually his fault they could not solve it and beg for extra points because they are used to always do great. Some time ago I posted here a ‘proof’ which one of my classmates did in a graduate-level math class. It almost made me cry, in short, she factored ‘x’ out of the integral which depended on ‘x’, they would not have let me finish high school if I had done that in the Czech Republic. So this girl still happily attends the class and I got the honor to read one of her papers we had to turn it. It was a complete disaster, she copied every single thing from the paper which it was based on, she not just copied it but also made a lot of mistakes in copying it, her sentences did not make sense, you could not call her proofs ‘proofs’ even if you were drunk and for all that she got 15 points out of 20. I wouldn’t give her even 10. However, that might probably touch her self-esteem and that’s not desired here.

I am not saying that being supportive and appreciating someone is bad. Especially with kids you should do that a lot. However, here it is led to extreme and moreover, college students are not kids anymore. Or at least they should not be. I have already lost the sense of what is meant honestly and what is just ‘American-like’. I basically have no measure whether I did well or bad because I always get a perfect evaluation. You have no idea whether people like you or how high they think of you because they always say you did a fantastic job. At the beginning, it makes you feel good, like you are really special, you do really so well. But with time, you get tired of that because you already see through it. Again, don’t get me wrong, I do not think teachers should be harsh on students, it is good to give someone encouragement and ‘push’ but not the fake one. In the Czech Republic or Germany where I got a chance to study, or even in my family, we do not flatter each other all the time. I know my parents love me and are proud of me but they do not tell me how amazing and talented and extraordinary I am every time I do something. Therefore, when they do tell me that, when they appreciate something I achieved or succeeded in, I can be sure they mean it and I value it very much then.

Tereza Eliášová is from the Czech Republic, and is currently studying for a semester in the United States. She was one of my students in Brno

Tereza

Tag Cloud