AI powered automated essay grading – concept

AI (Artificial Intelligence) has been roaring through every industry to this day and age. Whether it is self driving cars and other vehicles, whether it is predicting stock markets, AI has been used to automate repetitive process in every industry. Whether it is Finance, Law, Education, Healthcare, automotive, or any other industry, no industry has been left stranded of the Midas touch of AI. Science fiction writers have their favorite tool now. People have predicted so many amazing (or catastrophic) changes that will happen with the rise of AI.

While we are yet to create the self aware robots as seen in the movies, there are many processes that we have been able to automate. There are some mind blowing things even today that we can do with AI, especially with tools such as Machine Learning and Deep Learning. Automating the process of essay grading is one of such things. This thing opens so many doors for automation in education sector, where AI has not been able to make the level of impact as the other industries.

In schools or colleges, grading essays properly and impartially can be tedious work. Even with the lower grades, the grading of essays take a very large amount of time, time which can used in development of students, individual attention of students. There is another problem with the current grading process which often goes unnoticed is that it is very hard for a teacher to be grading every teacher with the same metrics. Impartiality is inevitable as human error comes into play. Although that does not seem like a very big problem, I reckon in 10-15 years, automated essay grading software will be just as accessible and necessary tool for teachers as a smartphone. We wanted to address that problem.

Our objective was to automate the essay grading process in such a way that the grading is done on a personalized level to the teacher. That is, Machine learns on the essays and grades provided by teacher and machine will grade the next essays which is closest to the grades that the teacher will give. So what that means is, teachers will get to maintain their grading styles while automating the process and saving them immense amount of time.

Understanding the process of grading:

Of course, one obvious thing that many data science and Machine Learning enthusiast fail to understand that ML is not just about models, libraries, rather it is least about that. If we want to automate the process using Machine Learning, we need to understand the process, identify the patterns, identify the features which affect the grading. Let us look at the major parts of the essays which are essential, generally to grade the essays:

1. Usage of words: This is most elementary and most essential part of essay of course. How the words are used, if there is spelling mistake in the words, how many words are used with the spelling mistake. Also, which word is chosen in the range of similar words. Why that word was chosen, whether the word was chosen to justify the context, or any other reason? Was same word was repeated in the essay or similar words are used in different forms of essays. All these things of course affect the grading of the essay.

2. Grammar and punctuation: This is also very important part of essay grading process. Is the grammar correct, is very important. Grammar itself depends on proper usage verbs. So phrases and clauses are the parts which contribute to the grading score. And of course, good punctuation is absolutely necessary for a good essay.

3. Keeping the theme: Keeping the sentences as to the topic and theme of the essay is very important feature as well. Of course it is harder to quantify this feature. But it is one of the important feature of course.

Now we need to fetch and quantify these features. That is where the power of word-embedding come in. One important thing to note here is we don’t need to match these quantified features with scores, we will just pass these numbers and model will do the connection itself. That is the power of deep learning. We just need to identify the features which affect the target, deep learning model will assign the appropriate words automatically.

What is word embedding?

Word embedding is a way to quantify words. What we do here is connect words to a bunch of numbers and then train them in such a way that words with same or similar meanings will have similar numbers. That is the numbers with lesser differences between them. Dimension of the embeddings is the quantity of numbers associated with one word. You can get complete understanding of word embeddings here. We used 300 dimensional embedding vectors (also known as glove) for the task. These glove vectors are added from open source pretrained vectors by Stanford. So we have a set of numbers defining each words.

Quantifying the features:

Now the task in hand is to quantify the features we had mentioned above. Let us go through them one by one.

1. Usage of words: This is easy with word embeddings, word embeddings are the quantified forms of the words, so the words which are tough enough and to the context will automatically get high scores. Of course, that will be the case if teachers prefer that part. Some teacher might prefer easier set of words. Model will learn based on the data it is provided.

2. Grammar and punctuation: Now this is the tricky part. What we do here is we use stopwords and punctuation data provided by NLTK library. And we fetch those stopwords in the given essay.

3. Keeping the theme/context: Theme/context here can be thought of the relation between different set of sentences. The closer the various sentences in an essay are, the more the essay stays in context. We measure closeness of the sentence by combining embeddings of each word in an sentence. Then, we create the vector for a sentence.

Then we work on the code and deployment after we have established the way to go and the understanding part. Stay tuned to know the challenges faced in coding and deployment and how we solved them.

Get the project


  • Williamcon

    Good day! fenixwork.com

    We present

    Sending your commercial proposal through the feedback form which can be found on the sites in the contact section. Contact form are filled in by our software and the captcha is solved. The profit of this method is that messages sent through feedback forms are whitelisted. This technique increases the probability that your message will be open.

    Our database contains more than 25 million sites around the world to which we can send your message.

    The cost of one million messages 49 USD

    FREE TEST mailing of 50,000 messages to any country of your choice.

    This message is automatically generated to use our contacts for communication.

    Contact us.
    Telegram – @FeedbackFormEU
    Skype FeedbackForm2019
    Email – FeedbackForm@make-success.com
    WhatsApp – +44 7598 509161

  • Shalanda

    It is really a great and useful piece of info. I am satisfied that you just shared this helpful
    info with us. Please keep us up to date like this. Thanks for sharing.

  • Georgia

    hey there and thank you for your information – I have definitely picked up anything new
    from right here. I did however expertise some technical
    issues using this site, since I experienced to reload the website lots of times previous to I could get it to load
    properly. I had been wondering if your hosting is
    OK? Not that I’m complaining, but slow loading instances times will sometimes affect your placement in google and can damage your high-quality score if advertising and marketing with Adwords.
    Anyway I am adding this RSS to my email and can look
    out for much more of your respective fascinating content.
    Make sure you update this again soon.

  • cerita dewasa bule

    I absolutely love your website.. Very nice colors & theme.
    Did you make this site yourself? Please reply back as I’m trying to create my own personal site and would like to
    learn where you got this from or just what the theme
    is named. Appreciate it!

  • Rosella

    First off I would like to say wonderful blog!
    I had a quick question in which I’d like to ask if you don’t
    mind. I was interested to find out how you center yourself and clear your head before writing.
    I’ve had a hard time clearing my mind in getting my ideas out.
    I do take pleasure in writing but it just seems like the first
    10 to 15 minutes are usually wasted simply just trying to figure out
    how to begin. Any ideas or tips? Many thanks!

  • Odell

    I do not know whether it’s just me or if everyone else
    experiencing problems with your blog. It seems like some of the text within your posts are running off the screen. Can someone else please provide feedback
    and let me know if this is happening to them as well?

    This might be a problem with my web browser because I’ve had this happen previously.

    Thank you

  • Penelope

    I like the helpful info you provide in your articles.
    I will bookmark your weblog and check again here regularly.
    I am quite sure I’ll learn many new stuff right here! Best of luck for the next!

  • Amee

    Hello I am so grateful I found your blog, I really found you by accident, while I was
    looking on Askjeeve for something else, Anyhow I am here now
    and would just like to say cheers for a tremendous post and a
    all round interesting blog (I also love the theme/design), I don’t have time to browse it all at the moment but I have saved it and also added your RSS feeds, so when I have time I will be back to read much more, Please do keep up the awesome

  • Idn poker

    Hello there! I know this is kinda off topic but I was
    wondering which blog platform are you using for this website?
    I’m getting sick and tired of WordPress because I’ve had problems with
    hackers and I’m looking at alternatives for another platform.
    I would be awesome if you could point me in the direction of
    a good platform.

  • sportbrandlline.com

    An impressive share! I’ve just forwarded this onto a friend who had been conducting a little research on this.
    And he in fact bought me lunch because I stumbled upon it for him…
    lol. So let me reword this…. Thank YOU for the meal!!
    But yeah, thanx for spending the time to discuss this topic here on your web site.

  • sportszone55.com

    Hi there, I found your blog by way of Google even as looking for a related topic, your web site came up,
    it seems to be great. I’ve bookmarked it in my google bookmarks.

    Hello there, simply became alert to your blog
    thru Google, and found that it’s really informative. I am
    going to be careful for brussels. I’ll be grateful when you continue
    this in future. Many people can be benefited from your writing.


  • berita olahraga

    Have you ever thought about publishing an e-book or
    guest authoring on other websites? I have a blog based upon on the
    same ideas you discuss and would love to have you share some
    stories/information. I know my readers would enjoy your work.
    If you are even remotely interested, feel free to shoot me
    an email.

  • film semi

    Great article! That is the kind of information that are meant to
    be shared around the web. Disgrace on Google for now not positioning this submit
    higher! Come on over and discuss with my website .
    Thanks =)

  • berita olahraga

    Howdy just wanted to give you a quick heads up and let you know a
    few of the images aren’t loading properly. I’m not sure
    why but I think its a linking issue. I’ve tried it in two
    different browsers and both show the same results.

  • how to watch free putlocker movies

    Hello I am so glad I found your webpage, I really found you
    by mistake, while I was searching on Bing for something else, Anyhow
    I am here now and would just like to say thanks a lot for a remarkable post and a all round exciting blog (I also love the theme/design),
    I don’t have time to browse it all at the minute but I have
    book-marked it and also included your RSS feeds, so when I have
    time I will be back to read much more, Please do keep up
    the great work.

  • Jerald

    Hello very cool site!! Man .. Beautiful .. Superb ..
    I will bookmark your website and take the feeds additionally?
    I’m happy to search out a lot of helpful information right
    here within the put up, we need develop extra techniques on this regard, thanks for
    sharing. . . . . .

Leave a Reply

Your email address will not be published. Required fields are marked *