Calculated Formula Questions

A Calculated Formula question contains a formula, the variables of which can be set to change for each user. The variable range is created by specifying a minimum value and a maximum value for each variable. Answer sets are randomly generated using a set of criteria you provide.

There is a known issue when using exponential numbers within Calculated Formula Questions, see bottom of this page.

Add Calculated Formula Question

Add Calculated Formula Question

1. From your test canvas, choose Calculated Formula from the drop down menu and click on Add.

Read Instructions

Read Instructions

2. On each screen and at each stage pay careful attention to the instructions shown.

Enter Question Text

Enter Question Text

3. Enter the question text.  Surround any variables with square brackets, for example, [n]. The value for this variable will be populated based on the formula we create in the next part.

Please note that Blackboard currently advise that this question type does not function correctly if the question is craeted with five or more variables.

Enter Answer Formula

Enter Answer Formula

4. Enter the formula used to answer the question.  Different operations are selectable using the buttons above the text.  For the variables use the same letters that are enclosed in square brackets in your question text.

Options

Options

5. Choose the options to suit your preferences.

Answer Range +/-
This defines which submitted answers will be marked correct. If the exact value must be entered, enter 0 and select Numeric from the drop-down list. If the answer can vary, enter a value and select Numeric or Percent. Numeric will mark every answer as correct that falls within a range of plus or minus the Answer Range from the exact answer. Percent will mark every answer as correct that falls within a percentage of plus or minus the Answer Range from the exact answer.

Allow Partial Credit
Define partial credit for answers that fall outside the correct Answer Range. Select Yes or No for Allow Partial Credit. Enter a value for the Partial Credit Points Percentage. Now, set the range for partial credit by entering a value and selecting Numeric or Percent for the Partial Credit Range. Answers falling within this range will receive a portion of the total points possible for the question equal to the Partial Credit Points Percentage.

Units Required
Select Yes or No for Units Required. If Yes, correct answers must include the correct unit of measurement, for example, Seconds or Grams. Enter the correct unit of measurement and choose if the unit of measurement is case sensitive. The answer may still receive partial credit if the unit of measurement is not correct. Enter a percentage in Unit Points Percentage. The unit of measurement will account for that percentage of the total credit.

6. Click on Next to continue.

Define Variables

Define Variables

7. You will see a list of all the variables entered in the question text.  Choose the minimum and maximum values for each variable.

8. Choose how many decimal places should be used for each variable.

Answer Set Options

Answer Set Options

9. Choose the number of Decimal Places for Answers. This determines the number of decimal places a student answering the question is expected to use.

10. Set the Number of Answer Sets. This means the number of possible variables that will be calculated at the next stage. The Answer Sets will be randomised so that different Students will be presented with a different set of variables.

11. Click on Calculate to calculate the answer set.

Modify Answer Sets

Modify Answer Sets

12. The number of answer sets you specified previously will be displayed.  You can remove any if you wish.

Note: There is a known issue at this stage. If you chose a number higher than 1000 for the answer range, Blackboard places a comma within the number. However this produces an error stating “There is an error in one of the input values provided for this question”. This is a known issue which will be resolved in the future. A workaround is to delete the commas from each row.

Enter Feedback

Enter Feedback

13. Enter Feedback for correct and incorrect answers.

Set Categories and Keywords

Set Categories and Keywords

14.  If you wish you may set categories and keywords for your question.  This is not necessary for the question to work.

Click on Submit

Click on Submit

15. Click Submit to finish.

Question Added

Question Added

16. You will see your final question listed on the test canvas.

From a student perspective

From a student perspective

17.  This is how the question looks when a student answers it.

Known Issue: Calculated Formula Question Marked Incorrect Despite Matching the Correct Answer

Issue Description: Calculated formula question marked incorrect despite matching the correct answer. This is an issue with the Calculated Formula grader when grading exponential numbers. Effectively when a User uses a higher or lower notation than the expected answer it will fail, although it is mathematically equivalent. A basic example is the answer for an exponential answer is: 1.66E-24 if you put the following value in: 166E-26 it will be marked as incorrect, even though it is mathematically correct.

Steps to Replicate:

  1. Create a new Course.
  2. Create a Test Assessment.
  3. Create a Calculated Question.
  4. Use the following Question Text: How many moles is a [x] molecule sample? For full credit include the correct abbreviated unit with your answer.
  5. Use the following Formula: x/6.022×10^23.
  6. Set Answer Units to: mol.
  7. Set Precision to 3 Significant Figures.
  8. Set the following MIN MAX values: 652.0. (0 Decimal Places)
  9. Set Correct Answer Forum to: Exponential.
  10. Set Answer Sets to: 1.
  11. Perform a calculate and make note of the answer. (It should be 1.66E-24)
  12. Save the Assessment and go in as an Instructor and attempt the Assessment. You should have set all feedback options to see the values being marked.
  13. In the answer box type the following: 1.66E-24mol.
  14. Submit the Assessment and see the feedback.
    • Note: You should have gotten a correct score. If not go in again and use that correct score to confirm.
  15. Now attempt it again and change the value by removing the period in the value and increasing the exponential value by 2. IE: 1.66E-24 will turn into: 166E-26
  16. This is still correct, and exponential works so that effectively you are just moving the decimal. So increasing it by 2 is still technically the right answer.
  17. Attempt to Submit with this new value.

Observed Behavior: 
Note that answer will be marked wrong, but they will show as the same. This appears to be an issue with how to grade these.

Expected Behavior: 
As the value is still the same, it should be marked correctly.