Showing posts with label assessment. Show all posts
Showing posts with label assessment. Show all posts

Sunday, January 23, 2011

Exams and Assessment

When Pamela was six years old, she could only echo back what you said in the last three seconds. When she was twelve years old, she could process a word or two and cue off that, usually misunderstanding what was said, leading to a meltdown. Her auditory processing has made huge strides since then.

Yesterday, Pamela wanted to go on a health food store run. I wasn't in the mood to sit in the car for an hour, so I made an excuse about not having time for I had to put away the Christmas decorations, which were down, but not stored. Pamela eagerly joined my in wrapping and storing the ornaments and even made three trips upstairs to find the paper towels. We finished after only a half hour of effort, so I lost my excuse.

Steve joined us because I was under the weather with a slightly sore throat. We stopped at McDonald's to pick up two small cappuccinos for the road. He told us about the difficulty of the folks at the Mickey D's in Monck's Corner have with making a cappuccino without flavor. He asked, "And what do you think they added?"and paused expectantly. From the backseat, Pamela chimed in, "Flavor!"

After we made it home, Steve asked me if I was going to church. I told him it depends. David asked why. Since Pamela discourages us from talking about illness, I spelled out my dilemma with the military alphabet, "Charlie Oscar Lima Delta." Even though she was in another room, Pamela bolted into the television room to ask, "Who's Charlie Oscar?" Before long, she's going to have us speaking in pig latin . . .

When I assess what helped Pamela make such wonderful progress, I can boil it down to three things: (1) three hours a day of reading books aloud to Pamela sharpened her auditory processing, (2) three years of the association method helped her with the mechanics of language, and (3) Relationship Development Intervention enabled her to think flexibly and engage socially.

What does this have to do with exams, you ask? For me, exam week has verly little to do with blue books, bubble tests, and sharp pencils. It is about discovering what Pamela knows, how much larger her world has become, and what milestones are in the making. It is about deciding how I am doing as her guide and about changing the curricula to make it work for her. Exams include not only assessing her, but also assessing me and the curricula.

I consider her exams a resounding success:
  • Pamela narrates better when I talk less (a lesson RDI taught me).
  • I need change to our old Ambleside Online standby A Child's History of the World for our history spine. Pamela lacks the background book for the book we were using and her narrations proved that point.
  • Pamela needs to build a background for world history before going to a detailed, chronological retelling. I plan to pull out another old Ambleside Online standby Fifty Famous Stories Retold and read one story about a post-Roman Empire person a week.
  • Next year, she can focus on history past the fall of the Roman Empire and will have the background stories to make her ready for it.
  • Pamela processes absolutely nothing about Greek mythology. I plan to table it until next year and, perhaps, build from a known (Disney's Hercules) by picking stories of gods and goddess from that movie and going from there.
  • Pamela needs two years with RightStart Intermediate Math rather than one.
  • After all these years, Pamela has a newfound sense of story. In her narrations, I see a beginning, middle, and end starting to emerge. Last year, all she could do was three unrelated sentences.
  • When she alternates reading aloud, Pamela needs very little guidance from me. She listens to me read and knows I will stop at the end of a sentence. If her eyes were not tracking, she remembers the last word I said (she repeats it aloud on her own) and finds it. Only occasionally will she ask me, "Where?"
  • Pamela definitely lives in a larger world. She learned about new people, new inventions, new plants, more about familiar animals. She learned new songs and new paintings and drawings. She understood more about the seasons and geography. She added more words to her vocabulary, which now has many Spanish words.
The Case for Narration
Over a hundred years ago, Charlotte Mason chose narration as the most efficient way to assess true understanding and to store new knowledge into long-term memory. Pamela didn't study for her exams. All last term, she took turns reading aloud sentences from her books and narrated what she knew. She drew maps for geography, and added drawings to her drawing notebook and drew pictures and wrote narrations for her timeline notebook. She did some nature study and experiments, recording her observations on paper. Education researchers call this "retrieval practice procedures and reconstructing knowledge."

A recent study compared the test preparation techniques of four groups. The first read a science text for five minutes. The second read the material in four consecutive five-minute study sessions (more is better, right?). The third made concept maps by filling in hand-drawn bubbles to connect ideas and concepts, the golden standard of modern study techniques. The fourth read the material, put the text away, spent ten minutes writing what they recalled in a free-form essay (what Mason called written narration), reread it, and wrote some more.

Note: Too many headlines are calling this taking a practice test. We all know that typical tests involve multiple guess and lots of WH questions. These researchers tested through essay, which is another way to say written narration, and, at least, Science Daily got it right!

The scientists found several advantages to retrieval practice procedures for storing new knowledge in long term memory:

  • Students show greater gains in meaningful learning.
  • Performance generalized across texts identical to those commonly found in science education.
  • Essays were effective for comprehension questions and inferences and for creating concept maps.
These surprising results have lead to speculation about why narrating what you read works. Education professor, Marcia Linn said students in the fourth group may "recognize some gaps in their knowledge and they might revisit the ideas in the back of their mind or the front of their mind." They can "retrieve it and organize the knowledge that they have in a way that makes sense to them." Psychologist Nate Kornell stated, "Even though in the short term it may seem like a waste of time, [retrieval practice appears to] make things stick in a way that may not be used in the classroom." More importantly, "It’s going to last for the rest of their schooling, and potentially for the rest of their lives."

My favorite education psychologist Daniel Willingham concluded with the howler of the day, "It's not totally obvious that this is shovel-read--put it in the classroom and it's good to go--for educators this ought to be a big deal."

Has he not been reading my blog? Written narration has been shovel-ready for over a hundred years! I can forgive him for he wrote an important article about why stories are so effective in the classroom.

I have a very simple lesson plan for almost everything. "Tell me what we read yesterday." If she has a blank, I might give her an anchor like "Yesterday, we read about poor King Alfred. What happened to him?" If it is a completely new topic, I might tie it into something she already knows. "Do you remember the book we read about Francis Marion? Well, today, we are going to start a new one about another patriot named Thomas Sumter. Sometimes, we consult a map before a reading or copy a picture.

Then, we read. Pamela and I alternate reading sentences aloud because it improves her oral expression. When we get a reasonable chunk of reading done, she stops and narrates. Then we read more and she stops and narrates. When finished, I look for connections to my life or other books. In one book, a ship was setting sail from Port-aux-Basque, Newfoundland. I told her that I had taken a ferry from that same city to Nova Scotia when we moved back to the United States. Sometimes, Pamela will tell me her connections: John the Baptist dressed like a caveman, the Swamp Fox reminded her of the movie The Patriot, and Lot's wife turned into a sculpture.

During exam week, I tried very hard to limit questions to generic things. "What happened next?" If she is having trouble with that, I tell her the name of the chapter and usually that is enough to job her memory. Sometimes, Pamela forgets to include the name of the person, the time, or the place. If I'm not sure she knows, I might say, "I wonder where he is from" or "I don't know who you are talking about." If I am absolutely sure she knows, I ask her a more direct question.

Julius Caesar Transcript and Video

    He [Julius Caesar] was a little boy. He wasn’t strong. He was growing up so fast. He has a sword. They went to France, Spain, and England. No London bell. They want to fight the soldiers. He was strong. He was strong enough. He was fight with the enemies. They fought. They won. Caesar had an election. They had parties [she means parties Caesar held to win supporters, not political parties]. [He grew up] in Rome. [He] lived in one B.C. century.
    Drawings
    The new thing this year was a drawing notebook. Some of our books have diagrams and illustrations. The process of copying them into her notebook is one more way to learn. During our exam, we talked about things she had learned about the weather. I was curious to see if she understood a new vocabularly word that we had only read about, discussed incidentally, and drawn in her notebook. We never drilled it. When asked "What is precipitation?" Pamela replied, "Rain, snow, flakes, and hail."

    Pamela drew two maps to illustrate two topics. She is one-third of the way through the book on the Lewis and Clark expedition. She started the journey in Pittsburgh because that is where the keelboat was built and mapped their progress so far. She also drew the plans for laying the first transatlantic cable. She hasn't finished the book yet, so the exact locations will become clearer and clearer. Pamela drew the phases of the moon too. For sculpture, she drew the Sphinx. When asked to draw a column for architecture, she pointed out the window to the column on the front porch and said, "Over there." She added the flowery flourishes at the top to be like the Egyptians.





    Monday, January 17, 2011

    Our First Exam Week: Spotlight on Recitation and Music

    In an effort to be authentic and transparent, I'm going to reveal the shocking truth about exam week in the Glaser homeschool. We never did it. You thought all Charlotte Mason homeschoolers did them. Well, I never got the hang of it. At least, I never lied to you and said I did. That would be hypocrisy.

    Because I always felt like we were behind (behind what, I wonder), I hated to lose even more time doing exams. It didn't kill David who ironically just exempted all of his exams for first semester of his senior year at high school (does God have a sense of humor, or what?). It was extremely difficult to assess Pamela because of her major stumbling block: aphasia! Five years ago, the oral language she is doing today didn't exist. I was still suffering from Enlightenment Thinking, so I would have either felt defeated when my children didn't seem to know what I thought they should know and I would have made the next term miserable for all of us.

    Now that I am a recovering Enlightenment Thinker, I think it is safe to try exam week with Pamela. What is Enlightenment Thinking?
    • Viewing Pamela as a performer.
    • Having a list of things she ought to know.
    • Correcting her mistakes and adding them to the list of things to fix.
    • Viewing her efforts as purely solo.
    • Trying to measure and collect data to prove to the world homeschooling is working.
    • Feeling bad about things that she missed because she did it correctly last week.
    • Measuring her against other people with autism who are her age.
    I am doing several things to inoculate myself from this destructive form of thinking. I am trying to view exams with an eye toward Pamela, the person, and her relationships by considering the following questions:
    • Is Pamela's world larger because of this book or activity?
    • Do I see her recalling or exploring ideas outside of our formal day?
    • Is her known in this area expanding?
    • Is this book or activity worth her time?
    • If not, is she ready for this level of thinking? Could I find a better resource?
    • Is she reaching any new developmental milestones?
    • Were there times when her face filled with joy?
    • Did she share any knew connections she made?
    Spanish
    Pamela's narration of Ricitos de Oro in Spanish stunned me, and Steve couldn't get over it. We have come a long way in Spanish since August. She has this story, the nursery songs, and all the audio stories Steve narrated loaded up on her i-Pod Touch. She loves listening to them in her free time. The other day, I caught her watching I even catch her watching The Fox and the Hound in Spanish. Pamela sometimes speaks Spanish in context such as saying "Tengo mucha hambre" before lunch or "No hay más!" after finishing a bowl of food. Once I sang, "Food, glorious, food" while David was feeding the fish and Pamela said, "La comida" (the food in Spanish). Pamela spoke what Spanish she could on our trip to El Salvador and even communicated with Rosa, who spoke no English, through Spanish and gestures. Starting to acquire a second language spoken by half of her family is a major developmental milestone.

    I plan to keep using all our resources although the songs are in a challenging key for us. Pamela and I keep switching octaves to sing with the singer on our recordings who must be a baritone. We will press on. I might try a free two-week trial of Speekee, an online program recommended by friends Penny and Queen Mum. It is geared for younger children and might suit her well. If she likes it, we might subscribe and have her work through the ten programs instead of the homemade stories when my schedule gets too full.

    Recitation
    Pamela loves recitation. She enjoys reciting what she learned last term. Sometimes, she will recite "The Lord's Prayer" and Tennyson's "The Eagle" for fun. She smiles during "The Lord's Prayer" at church. On two different occasions, Pamela spoke Tennyson's lines: while looking at live eagles in Awendaw and at a stuffed eagle at a wildlife refuge visitor's center. It reminded me of a Jane Austen novel when a character quotes a beloved poet. I can tell by her unusually crisp annunciations of the hard c sounds in the first two lines of the poem that Pamela can hear the alliteration and finds it pleasant. I can tell in the pace of her delivery that she feels the poem's rhythm.

    Were her recitations absolutely perfect? No! But I loved how Pamela put her own twist on "The Lord's Prayer" by blending the two different versions:
    And - our - forgive our debts.
    And we forgive our debtors.
    And we forgive those who trespass against us.
    She got stuck on the fifth line of "The Eagle" and turned to me, "What? What?" She knew it was on the tip of her tongue. She even tried to give me her only clue, "Thunder," because she knew it was in the closing line. Rather than look at it as a failure, I took the opportunity to show her two strategies. First, I repeated the fourth line. I was stuck, too! Then, I started the whole thing over and, as soon as I said, "He watches from," Pamela echoed from and flew solo until the end. It reminded me of what happened to Elizabeth Hughes at the Norfolk Admirals Game--how forgotten lyrics can quickly blossom into a beautiful moment when surrounded by people filled with heart.

    Music
    Music is going well. Pamela loved our folk song selections. I picked two songs from South Carolina ("I Got a Letter This Morning" and "When the Train Comes Along") and one familiar one ("Skip to My Lou").


    While Pamela may not be a candidate for American Idol, she captured that slightly off-key twang of the songs, which melted my heart. She nailed the lyrics of the first verse perfectly in only one song. In another, she artfully wove lines from several verses to make her own version, which is how these songs were created in the first place. In the final song, she used her own unique words. Her inventiveness captured the essence of what folk music really is when you think about it.

    Pamela loved the hymns I chose. She needed help finding a good key with Rejoice the Lord Is King and stayed right with me once she got going. Her version of Open Our Eyes, Lord is absolutely precious because she sings with her heart in that one.


    Pamela loves classical music. She has it on her i-Pod Touch and alternates between listening to Bach and Beethoven CDs in the car. She can accurately name composers of familiar music if we hear it piped in the store or on the soundtrack of a movie. Last term, we enjoyed exploring Vivaldi. She was already familiar with The Four Seasons and his mandolin concertos. We added the Magnificat and Gloria to her repertoire. Her favorite piece was Spring from "Four Seasons" and Pamela even hummed a few bars for me!