This page give an overview on how to connect to the Questionmark Perception survey system, create a question, create a survey, publish and get results.
For more detailed information click on one of the related links on the right hand side of this page.
Installing Perception v5 Authoring Manager
Install v5 Authoring Manager (AM) using the procedures outlined in the document ‘Getting started with Authoring Manager’ (available on the Perception web pages).
Connect to the shared repository (tcp://caa.soton.ac.uk:7800). Choose the survey repository. Create assessments in topic folders on the shared (‘central’) repository. If you work offline, create a local repository and drag the entire assessment folder structure to the local repository.
Create suitable topic folders under your root topic folder on the shared repository. We recommends that the number of folder levels should be kept to a minimum to reduce the risk of multiple versions of questions. If you wish to work offline, drag the entire folder structure to your local repository.
Author your questions. Questions can be created from scratch using the wizard or imported. Perception v5 provides facilities for importing questions from Perception v4.
Select an appropriate assessment folder in the shared repository and author your survey. The easiest way to create a new assessment is to use the assessment wizard.
The wizard will prompt you for a name and type for the survey, then ask for settings such as feedback, accessibility, open access, time limits, etc.
Do not select the option of locking the participants WorkStation (Requires QM Secure) unless you have a good reason to do otherwise.
Unless you plan to schedule the assessment for a particular timeslot, ensure that open access to the survey is allowed.
You will then be prompted to select some questions. Choose the questions you need from the topic folders in the central shared repository. You can select an entire topic or choose each question individually.
You will then be presented with another dialogue to provide assessment feedback and a web link to open at the end of the assessment.
When you have created the assessment you need to make it available to participants. For the Survey system, this consists of appending the assessment’s session ID to the server’s address
You can determine an assessment’s unique ‘Identifier’ by right-clicking on the assessment from Authoring Manager to obtain its properties, then right-click on the ‘Identifier’ row and click the ‘Copy’ menu item.
Paste it into Notepad, and append the 16-digit ID to the server’s address. Use this link to try your assessment.
Obtaining survey results and reports
Reports can be accessed via Enterprise Manager. Login using your Perception authors account. The username will always be your University username but your password will be provided during training or via e-mail. You can change your password in Enterprise Manager, but will not synchronise with your university password.
iSolutions supports a facility which enables students with additional examination requirements (AER) to use centrally managed workstations for typing and printing their scripts securely. Under this arrangement, an Invigilator logs into a managed workstation using a special account on behalf of the candidate. The candidate uses a restricted instance of MS Word to type and print their script. Their work is autosaved locally every five minutes. When they have finshed, they use a built-in file upload tool to send a backup copy of their work to a secure central folder.
The Learning and Teaching Enhancement Unit (ILIaD) has produced a video presentation showing how to use an AER-enabled workstation. This is available from the ‘Web links’ section on the right of this page: click the link, and when presented with the video, press the ‘Play’ button.
If there is a lower quality version of the video there will be a ‘HD’ button that can be unselected. This will lower the required network speed from 1.2Mb/s to 400Kb/s. This will also help if you have a bandwidth limit with your Internet Service Provider.
To play the video in full screen either press the full screen button next to the volume control or right click on the video.
Instructions for candidates and Supervisors are available as two PDF files from the ‘useful downloads’ links on this page:
How to use an AER workstation (SiteKiosk) – Candidates
How to use an AER workstation (SiteKiosk) – Invigilators
This demonstration will show you how to make a coaching report in QuestionMark Perception 5.
Questionmark coaching report demonstration in Panopto (opens in a new window)
To open Enterprise Manager use the links on the right hand side of this page.
Perception assessments now require scheduling before they can be taken by students. This extra step allows for greatly increased security, accountability and logging. For example staff can now…
- Have a single link for all exams, knowing that students cannot possibly see the exam before their exam session
- Limit students to only taking the assessment once, stopping any possible cheating by students leaving early and re-taking the exam
- Limit access to a particular timeslot during examinations
Questionmark Authoring Manager 5 is now available on University Windows 7 computers through AppV. This allows us to push the program and patches to your computer, without any installation or upgrades needing to be done by staff.
Surveys and tests can now be used on iPhones and other mobile devices. The surveys automatically format the page correctly based on the device used.
Assessments are now more accessible, allowing screen readers to correctly read an exam and doesn’t require a mouse to answer any questions.
When loading assessments the computer will automatically retry when the server is busy rather than showing an error message.
With each question answered, results are saved to a database allowing students to recover their assessment even after a total computer failure.
The University supports QuestionMark Perception as a central CAA service. Perception could be regarded as a ‘Swiss Army knife’ in the sense that it is extremely adaptable and could conceivably be used for almost any assessment application. It is supported by iSolutions for all types of assessment from small-scale low-stakes applications such as external surveys through to large-scale high-stakes assessments such as University Examinations.
Blackboard’s quiz engine is easy to use and is supported by iSolutions for low-stakes and formative use only.
In addition, there are other software systems that can be used for CAA in one way or another. They are in most cases more specialised or less scalable than Perception and are not supported centrally by the University. These include:
- WebQuiz which is supported by the GeoData Institute
- iSurvey which is a ‘light touch’ online survey system that is currently being transitioned to iSolutions
- Students with additional examination requirements (AER) can be supported using centrally managed workstations – see AER link on this page
Other systems will be added to this list as we become aware of them.
Note: If you wish to pilot an eLearning system, iSolutions may be able to provide a hosted loan server for it provided this has been agreed by the University eLearning Implementation Group (ELIG). An application for this can submitted using the form available on the eLearning Hosted Loan Server page (follow link on the right of this page).
This slideshow will show you how to create a coaching report.
Note: This is the accessible version of QuestionMark’s coaching report. For the normal version click on QuestionMark’s coaching report under ‘Related links’ on the right.
Select Enterprise Manager
In Enterprise Manager select Enterprise Reporter
Then “Coaching Report”
Create new report
Click “Create new” to make and customise a new report
This page allows you to customise the report
Select report template
Select a report template from the list
Pick a status
Pick a status, for example “only finished exams”
Choose save format
Now choose how you want to view or save the reports
Click on “Find Assessments” and choose your exam
To limit to a particular student use “Select a Participant”
To limit to a whole class use “Select a Schedule Name”
Save the report
Choose a report name
Your report is now available from the “Coaching Report” screen
Double click to view available reports
View single report
Double click again to view single reports
To save more than one report click “Select All”
Then “Batch output”
Choose the file format to save in and press “OK”
Click on “Download”
Open or save
Then open or save the files
Your files will now be available to view
This page has links to a fake exam written in the same software you will be using to take your online exam.
The following link is to an exam with a time limit of 10 minutes. It has 7 questions with different item types to give you an example of how questions will look.
This unsecured exam will appear in your web browser. The exam will look the same as the secured exam, but the interface will be different. It will work on any computer.
The following link is to the same exam as the unsecured exam above, but will load in the Questionmark Secure Browser in the same way as your real exam. This browser is only pre-installed on University of Southampton public workstations, so this link will not work at home or on an office pc.