Scottish Survey of Literacy and Numeracy 2011 – Publication of Numeracy 2011 Results
The results of the 2011 Scottish Survey of Literacy and Numeracy (Numeracy) were published on 28th March 2012. These can be viewed now at http://www.scotland.gov.uk/stats/bulletins/00965.
Supporting documents to the main report including full data tables, the survey design document and example questions from the survey have also been made available and can be accessed via the following links:
Data Tables
Survey Design Document
Example Questions from the Survey
Background
The Scottish Survey of Literacy and Numeracy ( SSLN) is an annual sample survey which will monitor national performance in literacy and numeracy in alternate years, for school children at P4, P7 and S2. It will also provide information which will inform improvements in learning and teaching and assessment at classroom level.
The SSLN has been developed to support assessment approaches for Curriculum for Excellence ( CfE). The guidance for assessment for CfE is set out in the Assessment for Curriculum for Excellence: Strategic vision and key principles published in September 2009 and in Building the Curriculum 5: A Framework for Assessment published in January 2010 and its supporting suite of publications.
The SSLN has been under development since 2009 and new assessment materials have been trialled in schools. The first survey in numeracy took place in May 2011, with results published in March 2012. The survey consists of a set of written and practical assessments and a questionnaire. Approximately 11,000 pupils in total participated in the 2011 survey from across the 3 stages being assessed ( P4, P7 and S2).
Assessments and Questionnaires
The assessments used in the survey are both practical and written, designed to assess the wide range of knowledge, skills, capabilities and attitudes across learning identified in the Curriculum for Excellence experiences and outcomes. They are designed to reflect the CfE requirements that pupils have achieved breadth, challenge and application of learning.
There are two questionnaires used in the SSLN: one for pupils and one for teachers. The pupil questionnaire collects information on factors that are likely to affect learning, such as pupil attitudes and experience in class. The teacher questionnaire collects information on how CfE has been implemented.
As part of the evaluation process a school feedback questionnaire also seeks perceptions and experiences of schools participating in the survey.
Trialling
New assessment materials have been developed specifically to be in line with the aims and purposes of CfE. Each year we will need to trial some new materials to be used in future surveys.
FAQs
Q: What is the Scottish Survey of Literacy and Numeracy ( SSLN) ?
A: The SSLN is a sample-based survey which will monitor national performance over time in literacy and numeracy at P4, P7 and S2. The information from the survey will support the development of improvements in learning and teaching.
Q: What information does the SSLN provide about pupil's education in Scotland?
A: The SSLN monitors pupil performance in literacy and numeracy at P4, P7 and S2. It provides a snapshot of Scotland's achievement in literacy and numeracy at a specific point in time and provides a comparison over time.
Q: Why change from the Scottish Survey of Achievement ( SSA) to the SSLN ?
A: The SSA was the national annual survey of pupil's achievement in the 5-14 curriculum at P3, P5, P7 and S2. The SSLN has been refocused to align it to Curriculum for Excellence and will sample survey learners at P4, P7 and S2 with a focus on numeracy and literacy in alternate years.
Q: When will the survey take place?
A: The survey takes place in May each year, alternating between Numeracy (2011, 2013…) and Literacy (2012, 2014…).
Q: How many pupils participate in the survey?
A: About 4,000 pupils participate in the survey at each stage ( P4, P7 and S2).
Q: How many schools are involved?
A: All schools are involved in the survey each year: two pupils in each P4 and P7, 12 pupils in S2.
Q: How are pupils selected for participation in the survey?
A: Pupils are selected to take part in the SSLN nationally, using random sampling administered by the Scottish Government's Education Analytical Services. This will ensure an accurate picture of numeracy skills can be gathered throughout Scotland for their class group.
Q: What does the survey involve?
A: Pupils selected to take part in the numeracy SSLN will:
- Complete assessment booklets, either paper-based or online
- Participate in an interactive teacher/pupil or group-based assessment, and
- Complete a questionnaire.
Using both interactive and written assessments, the survey measures the wide range of knowledge, skills, capabilities and attitudes across learning identified in the Curriculum for Excellence experiences and outcomes. The assessments are designed to reflect the CfE requirements that pupils have achieved breadth, challenge and application of learning.
Q: Will taking part in the survey affect pupils' learning?
A: Assessments like these are a regular part of a pupil's learning. Participation in the survey should involve no longer than 2-3 hours of a pupil's time and will not disrupt learning.
Q: What will the interactive assessments involve ?
A: For numeracy they are in the form of an interactive teacher/pupil assessment. This covers a subset of numeracy experiences and outcomes. For literacy, they involve group discussion to assess listening and talking.
Q: Why are there questionnaires for pupils and teachers?
A: The pupils' questionnaire focuses on factors that are likely to affect learning, such as pupil attitudes and experience in class. The teacher questionnaire focuses on how Curriculum for Excellence has been implemented.
Q: Schools participating in the survey each year could be perceived to be a burden. How will this be kept to a minimum?
A: The SSLN is designed to give a national estimate of achievement so the number of pupils needed in the sample is relatively small. The survey also takes place in three pupil stages which also reduces the burden (there were previously four stages). These two changes reduce the sample size by 75% in comparison with the 2008 SSA.
The Scottish Government has also withdrawn from participation in TIMSS and PIRLS, greatly further reducing the survey burden on schools. We would expect schools to plan how they will arrange the survey to ensure the minimal burden on staff and learners.
Q: When are the survey results available?
A: The first numeracy report was published in March 2012.
Q: What results are provided specifically for teachers?
A: Learning and teaching resources from the numeracy survey will be made available during 2012.
Q: What are the links between the SSLN and the new NQ Literacy and Numeracy Units?
A: The Literacy and Numeracy Units will develop and assess a similar set of skills to those being assessed through the SSLN. Young people will undertake these qualifications in S4. The Units will also be available to adult learners. The Units will be available in 2013/2014.
Q: What is the difference between the tests used by some local authorities and the SSLN ?
A: The SSLN is a sample survey aligned with Curriculum for Excellence which will provide information on performance in literacy and numeracy at P4, P7 and S2 on a national basis. The tests used by some authorities gather information for the authority use only.
Q: What are the benefits of schools participating ?
A: The SSLN will provide valuable information on literacy and numeracy performance at P4, P7 and S2 for the whole country. It will also provide information on important learning and teaching points to support improvement in classroom practice.
Q: How can schools build on the information from the survey?
A: Learning and Teaching resources will be developed by Education Scotland from the SSLN survey findings. This information will be made available to teachers, schools and authorities to support and inform learning and teaching practice in the classroom. It is intended that this information will be available during 2012.
Q: What role does Scottish Government have in the survey?
A: Scottish Government, Education Analytical Services Division has key responsibility for the project management, design, analysis, delivery and reporting of the SSLN.
Scottish Government, Assessment and Qualifications Unit has policy responsibility for the focus and direction of the SSLN to ensure that it complies with Curriculum for Excellence and Ministerial requirements.
Q: What role does SQA have in the survey?
A: SQA has responsibility for all operational aspects of the SSLN including the development and trialling of assessment tasks, printing and distribution of survey materials, the administration of the survey in schools and data capture of the survey results. SQA is also responsible, with Education Scotland, for developing criteria for assessing literacy and numeracy at first, second and third levels for the survey.
Q: What role does Education Scotland have in the survey?
A: Education Scotland has responsibility for developing criteria for assessing literacy and numeracy at first, second and third level for the survey. Education Scotland will also produce learning and teaching resources for schools from information provided by the SSLN.
Q: Does Scotland still participate in International surveys?
A: Yes. Scotland continues to participate in PISA (Programme for International Student Assessment) which is widely recognised as the key international measure of educational achievement in maths, science and reading. Scotland has withdrawn from participation in TIMSS (Trends in International Mathematics and Science Study) and PIRLS (Progress in International Reading Literacy Study), greatly reducing the burden on schools.
Q: How are pupils selected to participate in the SSLN?
A: Pupils are selected totally at random in order to ensure an accurate picture of numeracy skills can be gathered throughout Scotland for their class group. The aim is not to assess a pupil's individual performance.
Q: Why are there so few pupils in each school participating in the SSLN?
A: The survey design is restructured to reduce the burden on schools following feedback from teachers involved in the SSLN trials. However, because all schools are participating we are still able to produce valid results.
Q: Will schools receive each pupil's results?
A: Individual pupil results will not be available. To fully assess each pupil individually would require a much longer assessment. The results for individual pupils are part of a much bigger jigsaw, and when all the assessments of other pupils who are attempting different questions are put together we will be able to build up a picture of overall performance across Scotland.
Q: Can parents do anything to help children prepare?
A: The survey is administered by classroom teachers. No preparation is required.
Q: What about pupils with additional support needs. Will this be taken into consideration?
A: Yes. If the school normally provides additional support for assessments, for example, a scribe or photographic enlargement of materials, this can also be provided. Pupils for whom participation would cause undue stress will not be expected to take part
Q: What happens to the information collected?
A: Information is collected for statistical and research purposes only. Pupils' names and addresses are not collected as part of the survey. All data is held securely and no information on individual pupils or schools will be published. The collection, transfer, processing and sharing of SSLN data is done in accordance with the Data Protection Act (1998). We also comply with the National Statistics Code of Practice requirements and other legislation related to safeguarding the confidentiality of data.
Q: Where do I get more information?
A: If you require more information on the Survey, speak to your school. Further information for SSLN assessment co-ordinators administering the survey can be viewed on the SQA Academy website - http://www.sqaacademy.org.uk/.
Useful Links
For further information please use the following links: