The Optical Character Recognition (OCR) model is a text-recognition model that identifies and extracts text (both printed and handwritten) from digital images. You can train the model to scan a digital image and extract only the required information by using machine learning. This is especially useful when you want to process and retrieve structured data from a large volume of unstructured data.

This structured data can then be stored and processed by the businesses whenever required, thereby helping them simplify and automate their data entry processes. For example, structured data is the date and time of an email, whereas unstructured data is the entire content of the email itself. 

Creator supports two types of OCR models: you can build custom models suited to your business needs, or choose a ready to use (prebuilt) model that is ready to deployed in your applications for many common business scenarios.

You can build custom OCR models that can be trained to identify and extract only the required values. The custom OCR model utilizes an ensemble of industry leading text recognition technologies to identity and highlight the text in the case of custom OCR models. All the extractable text identified by the model will be now be highlighted to show that they're untagged values. You can then add and tag the fields whose values you want to extract from the images. The model can then be trained to extract and process the required text found in your images. 

The following GIF shows the required text values being extracted from the input image (Invoice):

OCR model prerequisites

You can build and train custom OCR models tailored to suit your business needs. Additionally, you can utilize our ready-to-use OCR model, which can be directly deployed into your applications.

Let's say you want to extract text from a certain set of input images. In this case, a custom OCR model would be better suited. In some cases, you might want to extract all the detected text from the input image. The ready-to-use OCR model can be used in this case.

What skills do you need?

• As the admin, you can create and use OCR models, whereas your users can only consume the models you've created. 
• You should know enough about all your business requirements to determine the dataset that'll be used for training your model.
• As a low-code platform, Creator doesn't require you and your users to have prior coding and Machine Learning (ML) skills to create and consume the prediction models.

What data do you need?

• You must have at least five images of similar layout to be uploaded as training data. 
• The images can also be of different layouts, provided you tag the extraction values correctly.

Which pricing plan must you be in?

• AI Models will be available for users in Professional and Ultimate plans. Refer to our pricing page to know more.

Which version of Creator should you be using?

• You must be using Zoho Creator 6 (C6) to be able to create custom AI models, whereas the ready-to-use AI models are available in both C6 and C5.

Example

Let's assume that you've built Zylker's Invoice Processing app using Creator. You've a form named Invoice Details, in which you add the details of your invoice along with a digital copy of those invoices. You need to extract certain data from the invoice such as the invoice date, invoice number, due date, and the billing address. This can be done manually by relying on paper invoices to process payments and maintain accounts. However, when multiple entries are involved, automating the extraction process saves a great deal of time and manual work.

Here's how you would use the OCR model in the above case:

1. Create a model:

• Identify the values to be extracted and select fields with their respective field types to store the values. Here, Invoice number, Invoice date, Due date, and Billing address will be the values to be extracted.
• Upload sufficient images of similar/different layouts and tagging the defined fields whose values need to be extracted. Here, you'll need to upload images of your Invoices.

2. Train the model
3. Deploy the model:

• Select an image field in the form which will contain the input for the model. 
• Add the fields defined earlier to store the extracted values from the image field. Here, Invoice number, Invoice date, Due date and Billing address will be the fields that'll store the values to be extracted (refer above GIF) .
• Upload an image in live to get the required values. The input in this case will be the image of your Invoice.

OCR Model Flow

Setting up your model

Add training data

Training data is the initial dataset that is used by the model to analyze data patterns, make interpretations, and arrive at a conclusion that helps it recognize text from images. To train an OCR model, you need to gather sufficient images of similar and different layouts. Next, you need to identify the values that you want to extract from the images you've gathered. Once the training data has been finalized, you can proceed to add fields to your OCR model.

• Add fields
• Add images
• Tag Fields

Add Fields

In Creator, form fields store the values entered by users. Similarly, the values that you want to extract will be displayed in the respective fields. Adding fields is used establish their definition them so that when the model is implemented in your Creator application, these fields will be listed in that application's form. You can select/deselect the pre-defined fields as required. Now that you've identified the values you need to extract from your training data, you need to add fields and their corresponding data types.

The images that you gathered earlier will come in handy now. The images can be pictures of documents that include bills, checks, invoices, passports, receipts, and so on. The text in these documents can be handwritten and/or printed, although printed text is preferable.

Once you've uploaded the required images, the text in each of the uploaded images will appear highlighted. Next, you need to tag values for the fields you'd added earlier in all the uploaded images. Tagging here refers to mapping or associating the added field to the value it must extract and display. You can tag a value by selecting and dragging over the corresponding value in all the images. For example, if you've added an Invoice Number field whose datatype is number, you must tag the value of the invoice number in the image. This is done so that the OCR model recognizes that these are the field values that need to be extracted from the input data.

Guidelines

Format

• Supported formats include JPEG, .PNG, .BMP, .TIF

Size

• Maximum size of each uploaded image cannot exceed 5 MB.
• Overall model size must not exceed 150 MB 

Language (for print and handwritten text)

• Currently only English is supported.

Others

• Upload clear images.
• If you upload images of different layouts, ensure you tag the extraction values properly.
• A minimum of five images of similar layout needs to be uploaded for proper recognition and extraction.
• You have to tag each field to its corresponding values in a minimum of five images for the training to be successful.
• A minimum of 1 field with its field type and a maximum of 10 fields with their field types can be extracted per model.
• To add an OCR field in your form, you must have an image field as the source field in that form. Source field here refers to the field in which the input image will be uploaded for the model to identify and extract text. If the supported field type isn't available in the form, you will need to first create one in order to deploy the OCR model. 

Model Summary

After adding the training data, you can review the model details such as Model Name, Model Type, training data, and number of images added. If you need to make any modifications, you can go back and make them. Otherwise, you can proceed to train the model. 

• Train model 
• View and manage model details
• Test model
• Publish and use model

Train model

Before you can actually use your OCR model in your application, you have to train it to perform the way you want. After you've selected and reviewed your training data, click Train to train your model.

View and manage model details

Once training your model is complete, you can view the model details, the model's versions, and its deployment details, if any. The model is now ready to be published and deployed into your apps.

You can manage your model in the following ways:

• Retrain - Since new data is always being generated, we recommend that you periodically retrain your model. This helps in improving the OCR model's reliability and accuracy in extracting values. 

• You can click Re-train model and your model will be retrained.
• After each retraining is over, a new version of the model will be created. You can switch between different versions according to your needs.
• If you want to delete a version that is currently being used, you need to switch to another version before proceeding to delete it. 
• If the model training fails, you'll see 'Model training has failed!' Meanwhile, the previous working model will be used for prediction. 
  
• Note:
  
• The retrain option is available only when you add training data via form fields. This is because you can train your model as and when new records are continuously added to your application. 
  
• When adding data via CSV file, you can delete the model, upload a new file, and then train the model again.
  

• Rename - You can rename your model if required.
• Delete - If you want to delete your model due to inconsistent or wrongly-added data, you can use the Delete option.

Test model

Improve your OCR model performance

After you've trained, tested, and evaluated your model, you can tweak your model to improve its performance. Now here are some things you can try to help improve your model's performance.

• While gathering images, ensure that they contain well-aligned characters so that the model can easily recognize the text.
• Ensure to gather and upload high-quality images. The higher the original image quality, the easier it is to separate the characters from the rest, and the higher the accuracy of the OCR model would be.
• You can try to increase the contrast between text and background to bring more clarity to the output. 
• When employed on printed text, the OCR engine is highly accurate.
• Ensure that the images aren't turned upside down. Make sure you get the image in the right format and the text should appear horizontal and not inclined. 

Publish model

After you train your model, you can publish it to make it available to your users and start making predictions. Learn how

To use your OCR model in an environment-enabled Creator application, you must have at least one version of that application published in the production environment. After deploying your model in the application, you can filter between different stages of the environment to check which stage is the model deployed in. Learn how

Use model

After you've published your model, you need to select the application and form in which you want to deploy your model. You'll be redirected to the chosen form, where the fields that you defined earlier will be listed in the form builder. You can select/deselect the fields as required.The fields that have been deselected will not be added in that form. For example, you might be using the same OCR model in two forms. You might not require the same set of fields in both the forms and can deselect the ones that are not required. 

A new OCR field will be added in your form, in which you can upload an image of your choice. The OCR model will analyze and display the extracted values in the defined fields.

Get started with sample data

To help you get started quickly with OCR, we provide sample data that you can readily use in your Creator applications. You can scroll down and download the attachment

Related Topics

• Understand AI Modeler
• Custom AI Models
• Build and Manage OCR Model
• Understand OCR Field