The training of coders
The training of coders was suprvised by Marleen Groeneveld. A team of 4 researchers was taught how to observe children, using videos of a pilot concert. The Leuven scale, a description of 9 signals, that indiciate involved/uninvolved playing of children was used as a basis. Adjustments to behavior in concerts was made based on interviews with experienced presenters.
3 sessions were organised with Marleen to make improvements.The coders were tested, coding several fragments independently. The results were discussed. After another collaborative session a second test was carried out. This test proved a high reliabilty of the coders. The avergae Intra Class Correlation was 82-92. This is considered good to excellent.
Example of coding assignment “engagement in music”
Ilona Sie Dhian Ho.
Video 5 (first 2:25 minutes, music only)
Video |
5 |
Child |
14 |
Description child |
Boy on first row short shorts, blue shirt |
Signals of high engagement: 1. Concentration: He shows to be in the music in the first bit. He looks shortly at his neighbours (00:23) but then again has gaze is on musicians. 2. Energy: The ending he seems to somehow reflect the apotheosis of the cadenza, looking happy. 4. Posture: His head is slightly forward when he is focused on musicians, as captured by it. 7. Response: if he reacts on the music, he does so promptly. (just before ending he feels the end is coming?) |
|
Signals of low engagement: 1. Concentration (after 00;48) is generally low on music but at times high on booklet, (what would have happened if he would not have been distracted by girl behind him I wonder.) 2. Energy: No clear movements connected to music, but perhaps a bit at the ending cadenza. 4. Facial Mimicry: yawning (1:06) and once more (?) 4. Posture is very casual, not attentive, connected to music. 5. Persistence: he is focused sometime on the music but once he is distracted, he does not go back to the music for long time. 9. Satisfaction: Does not show satisfaction after the piece. |
|
Other remarks: He does show real focus, but only a short time because he is distracted. But the time he is listening is intense. |
|
Score Range from 1 (very low) to 5 (very high) |
2 |
Video 5 (first 2:25 minutes, music only)
Video |
5 |
Child |
17 |
Description child |
Girl second row, hear band |
Signals of high engagement: 1.Considerable amount of time keeping gaze to musicians. 4. Mimicry: Open mouth, could indicate attention, but also being sleepy 5. Persistence: neighbour girls trying to distract her but this is not easily done, she seems to be really in the music in the beginning
|
|
Signals of low engagement: 4.Sleepy eyes and a bit sleepy posture as well 4. Posture change (01.50), going more up, indicates she has been sleepy a bit? 4. mimicry: (2.09) eyes blinking, as if waking up a bit 9. No sign of satisfaction at the end of piece 3. Energy: does not show real reactions to music |
|
Other remarks: …Not completely clear to me if the open mouth is a bit “normal” look for this child or a sign of concentration or sleepy even. The movements indicate she is “waking up” so then she must have been sleepy? The beginning gaze was perhaps over-focused or dreamy, which caused not being easily distracted. |
|
Score Range from 1 (very low) to 5 (very high) |
2-3 |
Video 5 (first 2:25 minutes, music only)
Video |
5 |
Child |
28 |
Description child |
Girl second row, next to teacher |
Signals of high engagement: …1. Beginning of the piece gaze is strongly to musicians 2. Music development and big run in piano is keeping her attention (around 1.20), but when this is over eyes are gone. 4. posture is generally leaning forward a bit, as captured by the musicians. 4. facial mimicry: biting lip(?) perhaps because of music. At the end again, but here it is somewhat different. |
|
Signals of low engagement: 1. Eyes are already leaving focus on musicians soon (0;28) She is distracted by booklet 2. Energy: No reaction to music in movements 5. low persistence in gaze, eyes going to different places, movements not related to music.
|
|
Other remarks: … |
|
Score Range from 1 (very low) to 5 (very high) |
2 |
Video 6 (from 1:14 minutes, music only)
Video |
6 |
Child |
13 |
Description child |
Girl first row, fourth child (lock of hair) |
Signals of high engagement: 8. Confirming the attention of neighbour boy, because of music. Very beginning (1;15) 4. facial mimicry and posture: head turned sideways, with eyes on musicians (1:31) 8. verbalization: asking boy for confirmation 2. energy? Reaction to music when violinist playes flute tones, she seems to be drawn back to the musicians. (1:50) |
|
Signals of low engagement: 9. Absolutely no satisfaction at end or clapping 5. low persistence: already looking in booklet (1.28) and eyes are not really focused |
|
Other remarks: How should the suddle interactions between children be coded, thexe occus quite often as to want to enjoy together, asking confirmation :”do you hear that as well?” … Because there is no satisfaction at the end I coded rather low at the end, but this might be a too strong interpretation?
|
|
Score Range from 1 (very low) to 5 (very high) |
2 |
Video 6 (from 1:14 minutes, music only)
Video |
6 |
Child |
17 |
Description child |
Girl second row, hear band |
Signals of high engagement: 2. Moving with shoulders on music and smiling 1. Concentration: gaze is focused. 4. facial expression at beginning is positive, according to musical atmosphere 2. energy, clapping at the end is clearly positive 9. satisfaction is shown at the end, although not immediate, smiling, (2.16) 8. Verbalization without words? As asking for positive confirmation to neighbour at the end. (2.20) |
|
Signals of low engagement: 7. the response at the end is rather late, but this might be also because of still being “in the music 2. after the beginning she does not move with the music anymore. |
|
Other remarks:It is easier to code if you have seen the child in several pieces of music in order to know more about the general behaviour and characteristics of the face.
… |
|
Score Range from 1 (very low) to 5 (very high) |
…4 (5) |