Help Center

How to quickly get up and running with Kritik

What is Kritik

Kritik is an online peer-to-peer interactive learning platform designed for professors to engage students in a twenty-first-century way. Students can make online submissions for assigned activities and be evaluated based on rubrics designed to help students emulate a professor-standard grading process. Students will also receive constructive written feedback from their peers. When you assess your peer's work, you receive a grading score for critical thinking based on the fairness of your evaluation and a feedback score on the effectiveness of your written comment. The grading score and feedback score are known together as the Kritik score. They are calculated and adjusted automatically by Kritik’s scoring system.

Through a gamified experience, Kritik allows students to develop higher-order thinking skills from creating assignments as well as analyzing and evaluating peer submissions. In addition, students will develop the skills necessary to deliver feedback to their peers through our feedback-on-feedback system.

How Kritik Works

Professors aim at designing activities and rubrics that test the student's high-order thinking skills (HOTS). Activities can be assigned individually or as a group.

Individual Activity

For individual activities, each activity is divided into three phases: Create, Evaluate and Feedback. By completing all stages, students will gain a deeper understanding of the subject matter.

Stage 1: Create

In the Create stage, follow the activity instructions and read the provided rubric to create your submission. This submission is called a Creation. Once creations are submitted, they can be edited any time before the creation stage deadline.

Why is My Submission Called a Creation?
In Kritik, we encourage activities to be designed in a way to deepen your understanding of a subject. This way you can create something new with what you have learned.

Stage 2: Evaluate

In the Evaluate stage, you play the role of an evaluator. You will be assigned a few peer creations to evaluate. Similarly, your Creation will also be evaluated by a few of your peers.

Note: Evaluations are done anonymously. You will not see who you are evaluating, and your peer will not know who evaluated them.

You'll be evaluating your peers in two ways. You will score your peers based on a rubric given in the activity and give a written evaluation.

Why Evaluate My Peers?
By evaluating your peer's Creations, you will master a new skill set. And through this learning experience, develop a stronger understanding of the subject matter.

By seeing how your peer's approached the activity, you will gain new insights and knowledge that you can apply in the future
By evaluating your peer's Creations, you will develop essential skills on how to self evaluate and improve the overall quality of your work

Stage 3: Feedback

In the Feedback stage, you are given the opportunity to provide evaluators feedback on how they evaluated you. Similarly, your peers will give you feedback on how you evaluated them.

During this stage, you will be helping each other learn how to become stronger evaluators. You will score the peer evaluator on two different aspects of their written evaluations.

Motivational: How motivating was the written evaluation
Critical: How helpful was the written evaluation

Tying it all together

Finally, at the end of the three stages, you will be given three scores. You will be scored on your Creation (Creation Score). You will be given a score for participating in each peer evaluation and feedback task assigned to you. And, you will be granted points on how strong of an evaluator you are (Kritik Score).

How Does My Instructor Participate in the Activity?
Throughout the three stages, your instructor or TAs can view all creations and evaluations at any time. They may choose to edit or revise the creation score, comment on creations and peer evaluations and/or resolve grade disputes as they see necessary.

Group Activity

For group activities, each activity is divided into two phases: Create and Evaluate. Students are expected to collaborate with one another to challenge their high-order thinking abilities. Remember groups, are assigned leaders who will submit on behalf of everyone. However, every member of the group must submit their peer evaluations individually.

How Scoring Works

Kritik ultimately evaluates three overall scores on your dashboard once activities are finalized by your professor.

The Overall Creation Score is the average of all your creation scores per activity.

Kritik Score is the combination of the Grading Score and Feedback Score you receive as a peer evaluator.

The  Participation Score is the overall average of participation scores per activity.

Importance of Kritik Score

The Kritik Score represents how strong of an evaluator you are. It is the accumulation of all Kritik points that you have gained or lost over the past activities. You can click on “Show Details” to see the progression of your Kritik Score. After a few activities, you should expect your Kritik Score to increase to reach the 6000 point mark gradually. Most professors assign at least five or six activities throughout the semester. That should be more than enough for you to achieve the maximum Kritik Score unless you skip peer reviews or often lose Kritik points due to poor peer reviews.

Grade Breakdown

Kritik Score

How Kritik Score is Calculated?
Your Kritik Score a combination of how well you graded your peers (Grading Score) and how robust your written evaluation was (Feedback Score). All of this is measured when you complete peer evaluations and feedback on feedback submissions.

Grading Score

Grading Score is defined by how accurately you score your peer's Creations. Grading Score is calculated by comparing the score you gave a peer's Creation to the final grade of that creation. Unless the instructor overwrites it, the final grade of a Creation is the weighted average of the scores you and your peers gave. The closer you are to the Average Creation Score, the more points you will gain for your Grading Score.

For example, if your peers score a creation on average a 2, but you scored it a 4, you would be off by a factor of 2 and would lose Grading Score.

Why does Grading Score Matter?

The higher your Grading Score, the higher the impact or weight will be on the scores you provide as a peer evaluator.

For example, if you and another peer score a Creation but you have the higher Kritik Score, the average for that Creation will be closer to what you scored it.

Feedback Score

The quality of your written evaluation scored by the peer you evaluated. During the feedback stage of an activity, the peer you evaluated will score your written evaluation based on how Motivational and Critical you were.

Motivational. As an evaluator, was your evaluation motivating or discouraging?

A positive and motivational written evaluation highlights areas of strength within the Creation. If you are unable to identify any strengths in the creation, keep an encouraging and constructive tone when delivering criticism and/or areas of improvement Avoid making assumptions on the creator's intent and subjective comments.

Critical. As an evaluator, how helpful was your written evaluation?
A helpful written evaluation explains the impact of the mistake your peer made, as well as what they can do differently to improve. If ever you give a creation full marks, use the comment section to question the author in new perspectives whether it’s raising the bar for excellence or for minor improvements. Remember to make your criticism constructively so as not to lose points on the Motivational scale.

What if I missed a Peer Evaluation or a Feedback-on-feedback submission?
If you missed an evaluation you are not at a total loss. Only your Participation Score in the evaluation stage is affected but your Kritik Score is not directly impacted. Kritik Score is calculated from completed evaluations only. Although you missed the chance to rank more KS points, you are not at risk of losing any points. As the course prolongs, there are many chances for you to increase your Kritik Score by completing all evaluations per activity.

Kritik Score Rankings

Once you enrol in the course, you start off with a Kritik Score of 2000 points (Rank 2). When you complete an activity, you gain or lose Kritik points based on your performance as an evaluator. At every 1000 point gain, you go up in rank, and your profile border changes. Below is a list of all the ranks and their respective Kritik Score ranges.

Creation Score

How Creation Score is Calculated?
The creation score for each activity is the weighted average of what your peers evaluated your submission.

How does the Weighted Average work?
For every peer evaluation on your submission, the grade provided is multiplied by the peer evaluator's grading score. The average of all these peer evaluations will amount to your creation score per activity

Participation Score

How Participation Score is Calculated?
The Participation Score consists of your participation in both the peer evaluation and feedback stages. Participation per activity represents a number of your evaluation submissions plus feedback on evaluation submissions divided by the number of evaluations and feedback pieces assigned to you. You will not be penalized if you were assigned a lower number of evaluations or if some of your peers missed providing evaluations. The overall participation rate is the total average of participation in all finalized activities.

Key Takeaway
On the course information page, you will have access to the Course Grading Scheme. Here, professors can allocate either grading points or a percentage to each score achieved through Kritik.

How to Evaluate a Peer

Scoring

For rubric evaluations, carefully follow the descriptions provided in the rubric cells when giving points.  In the comment section refer to criteria done well within the rubric and bring up one or a maximum of two important things that your peers could do to improve, but don’t forget to mention any great things about their work to reinforce those actions. Make your points clear and actionable and if possible, provide specific examples.

Written Evaluation

It is crucially important to keep a positive and constructive tone and avoid using words that may demotivate the readers or offend them. Our brain has evolved to remember negative feedback much longer than positive ones. Therefore, for every critical feedback on areas of improvement, you should mention two or more things that are positive or encouraging about your peers’ submission, so reading your feedback will leave them with a net neutral or positive feeling and keep their motivation.

Starting out

Don’t worry at the beginning when you are still uncertain how to evaluate or provide comments. It is your participation that matters. After completing a few activities and peer evaluations through the semester, and by paying careful attention to the changes to your Kritik Score as well as any potential comments you may have received from peers you have evaluated, you will soon learn how to fairly evaluate others work just like a TA!


Note: Evaluations are done anonymously. You will not see who you are evaluating, and your peer will not know who evaluated them.

How to Give Feedback on Feedback

In the Feedback stage, all the comments and evaluations from your peers will be revealed to you, while their identity remains anonymous. You have the opportunity to give feedback to the evaluators based on the quality of their comments and help them adjust their feedback delivery in future evaluations.

Feedback Scoring

You are required to give your feedback through plotting their comments on a scale of how motivational (ranging from Very Discouraging to Very Motivational) and critical (ranging from Incorrect Direction to Very Helpful) it was. You may also submit a comment for further instruction.

For example, if you feel the evaluation comment is not only unhelpful but also instructs you in the wrong direction, pick the point “Incorrect Direction”. If you feel the comment is simply too soft and does not challenge you to improve, pick the point “unhelpful” on the left side of the critical spectrum. Similarly, if you feel the tone is harsh and or doesn’t acknowledge any positive aspect of your submission, you may choose a point on the left side of the motivational scale.

How to Dispute a Score

After you have received the evaluations from your peers, and while the activity is still in the "Feedback" stage, you may dispute your grade only if you believe your overall grade does not fairly reflect your submission based on the rubric.

When you dispute the score, your teacher or TA of the course will be notified. They will review your work and resolve the dispute by either increasing, decreasing or keeping your grade. Keep in mind that your action to dispute is a reflection of your evaluation skills. Therefore, you may lose your Kritik Score if the teacher doesn’t agree with your dispute.

Flagging Comments

You may also flag your peer's comments if you think they are offensive or inappropriate. Flagged comments will be under review by the professor.

The Science behind Kritik

Lower Levels of Cognitive Learning

According to the paper published by Benjamin Bloom in 1956, the complete cognitive functioning in learning must include six core elements. First, Memorization which is remembering and recalling names, and labels. Secondly, Comprehension, understanding how a concept works and being able to explain it beyond the mere vocabulary we initially memorized. Third is Application, which is applying the concept that we understand in a real-life situation. Above are the first three stages of Bloom's Taxonomy. Furthermore, up until Application, we have completed the lowest half of the cognitive levels.

Higher Levels of Cognitive Learning

Next, we are going to deepen our learning by entering the higher order thinking realm following with Analysis. Analysis consists of breaking down ideas or objects into smaller components, drawing connections and finding evidence to support generalizations. Next, Evaluation is rejecting or defending a stand or decision based on Analysis. Finally, at the highest level is Creation, which is an individual being able to produce a new idea or object by compiling components in a creative and innovative way. Kritik focuses on strengthening students' higher order of thinking skills (HOTS), also referred to as critical thinking skills.

Student Account Creation

Welcome to Kritik

A Kritik account gives you access to multiple courses with a single login. With a Kritik account, you can:

1. Submit Assignments
2. Evaluate Peer Assignments
3. Receive Feedback on Feedback

Starter Guide

Step 1: Enrollment Invitation

If you are using Kritik for any of your courses, make sure your professor has sent your student email with an invitation to enrol. You can find the invitation in either your spam folder or in your inbox. Follow the instructions for navigating in Kritik on the invite.

Step 2: Create an Account

When using Kritik we recommend you use browsers like Chrome or Firefox. Create an account if you're a first time user. Make sure the email matches the email address to which the enrollment invitation was sent. Change the role type from Teacher to Student, if you are a student.

If you are not a first time user, log in with your existing account.

Step 3: How to Purchase Course Access

Kritik supports the following payment methods: Visa, Mastercard, and Amex. Debit cards and credit cards are permissible except for prepaid cards. If you require further support or a receipt, contact us through the live chat.

REFUND POLICY

Kritik allows refunds within a span of 2 weeks from the date of the purchase day of your order. To request a refund, please contact us at support@kritik.io or contact us directly using the live chat.

Step 4: Edit Account Information

To edit any account information from updating your email to changing your password this can be done in the Account Setting. Click on the student icon to access Account Settings.

The stars that surround the picture represent your Kritik Score. To update your profile, go to Account Settings and click on the "About" tab. By uploading a photo, you can change your profile image here. Remember that only .png or.jpeg image files are supported.

Step 5: Notification Preferences

To turn on notifications, access the course page and click on the “Preferences” tab to turn on notifications. If you would like notifications to be sent via text messages, click on Account settings and add your phone number.

Frequently Asked Questions

Can I edit a creation after I submit it?
Creations can be edited as long as its before the creation stage deadline.

Can students see my peer evaluations?
Throughout all stages of Kritik, students will remain anonymous. Peer Creations, evaluations and Feedback comments all remain anonymous

Can I edit my Peer-Evaluations in the Evaluation Stage?
Once evaluations are submitted they can be edited anytime before the evaluation stage deadline.

What is the difference between the Evaluation and Feedback stage?
The evaluation stage is when you score and provide comments for peer creations. In the Feedback stage, you evaluate comments received on your creation.

What is a Kritik Score?
Kritik score is a combination of how well you graded your peers (Grading Score), and how strong your written evaluation was (Feedback Score).

Can I get a refund?
Kritik allows refunds within 2-week period from the time of your payment days of purchase. To request for a refund, please contact us at support@kritik.io or contact us directly using the live chat when you need an immediate response.

How do I enrol in a course?
Verify your professor has sent out an enrolment invitation to your student email. Next, search your inbox or spam folder for "Invitation to Join" or noreply@kritik.io. Follow the instructions in the enrolment invitation to enrol in the designated course.

If I miss an evaluation, will it affect my Kritik score?
Missed evaluations will affect your participation in that stage. You won't lose any KS if you missed an evaluation. KS score calculated scores are based on evaluations completed only.

Why does my Kritik score start at 2000?
All students begin with 2000 KS points and as activities finalize, you can increase your KS count up to 6000. You may however lose your Kritik Score down to 1000 points.

What does a high Kritik score mean?
The higher your Kritik Score, the stronger and fairer evaluator you are. You will play a bigger role in evaluating your peers and determining their final grade.

What is a good Kritik Score?
It depends on the number of activities completed. You start your course with a score of 2,000. Then, for each activity you can earn or lose up to 1,500; however, it is rare to gain the full Kritik Score per activity. Typically, after the first 3 finalized activities, a good evaluator will reach more than 4,000. The highest rank (diamond) will be granted to those who have reached 6,000 or more points.

How does Kritik Score impact my grade?
If your professor has allocated a grade to Kritik Score, it means that you need to aim for 6000 points by the end of the semester to obtain the full grade associated with Kritik Score.

Can I upload a file in the creation stage?
Yes only permitted files can be uploaded in the creation stage.

Why can’t I open a file from a peer creation?
Make sure the file extension is correct. If not, download and rename the file to the correct extension. (e.g. .docx, .pptx).

I have received a blank Creation, how am I supposed to grade?
If there is no content attached, grade it the lowest with a comment to reflect the problem. Also let the Kritik support know through the live chat to investigate.

What if I detect plagiarism in my peer's creation?
You are responsible to report any plagiarism you detect to your instructor and mark the Creation the lowest you can.

Pending Page

How Marks are Calculated

  • Creation mark: your total rubric grade for the HOTS activities: It is typically the weighted average of the rubric grades given by your peers, unless the instructor has edited it.
  • Kritik Score: Your most recent Kritik Score, displayed by the border around your profile photo or in your dashboard.
  • Feedback Delivery Score: Average feedback-on-feedback points you received from students you peer evaluated in the last completed activity.
  • Participation to peer evaluation: It is the percentage of completed peer evaluations during Evaluate stage.
  • Participation to Feedback on Feedback: it is the the percentage of your completed Feedback-on-Feedback task you have completed during Feedback stage.
  • Your Kritik Score and Feedback Delivery Score (FDS) are always available in your dashboard while the other grades can be accessed by downloading your gradebook excel file.

Pending Page ....................

Pending