Title:

Communication system and control method thereof, and computer-readable memory

Document Type and Number:

United States Patent 7440617

Abstract:

A mobile terminal reads a read manuscript as image data. A character recognition block performs character recognition from the image data, which is read, on the basis of a threshold for judgement of unrecognizableness. A character recognition result is transmitted to a central control unit, or the threshold for judgement of unrecognizableness is received from the central control unit in a threshold receiver. On the other hand, the central control unit receives the result of character recognition from the mobile terminal, or transmits the threshold for judgement of unrecognizableness from a threshold transmitter to the mobile terminal. Furthermore, the central control unit controls the threshold for judgement of unrecognizableness with a threshold controller.

Inventors:

Kaneda, Kitahiro (Kanagawa, JP)

Plaque It!

Application Number:

11/081504

Publication Date:

10/21/2008

Filing Date:

03/17/2005

View Patent Images:

Images are available in PDF form when logged in. To view PDFs, Login or Create Account (Free!)

Export Citation:

Click for automatic bibliography generation

Assignee:

Canon Kabushiki Kaisha (Tokyo, JP)

Primary Class:

382/219

Other Classes:

382/187, 709/203

International Classes:

G06K9/00

Field of Search:

382/218, 382/219, 382/187, 709/203, 382/181

US Patent References:

5235654	Advanced data capture architecture data processing system and method for scanned images of document forms	August, 1993	Anderson et al.	382/180
5546538	System for processing handwriting written by user of portable computer by server or processing by the computer when the computer no longer communicate with server	August, 1996	Cobbley et al.	709/203
5671067	Facsimile apparatus for optically recognizing characters and transmitting the recognized characters and communication system for transmitting the recognized characters between a terminal and a center	September, 1997	Negishi et al.
5796863	Method for training an adaptive statistical classifier to balance unigram prior factors	August, 1998	Lyon	382/157
5802179	Information processor having two-dimensional bar code processing function	September, 1998	Yamamoto	380/51
5848187	Method and apparatus for entering and manipulating spreadsheet cell data	December, 1998	Bricklin et al.	382/187
5982928	Character recognizing apparatus and method of controlling the same	November, 1999	Shimada et al.	382/187
6041133	Method and apparatus for fingerprint matching using transformation parameter clustering based on local feature correspondences	March, 2000	Califano et al.	382/124
6668101	Image processing apparatus and method, and computer-readable memory	December, 2003	Kaneda	382/301
6891972	Communication system and control method thereof, and computer-readable memory	May, 2005	Kaneda	382/187
20020061137	CUMMUNICATION SYSTEM AND CONTROL METHOD THEREOF, AND COMPUTER-READABLE MEMORY	May, 2002	Kaneda	382/218
20050163376	Communication system and control method, and computer-readable memory	July, 2005	Kaneda	382/181

Foreign References:

JP58182956	October, 1983	FACSIMILE DEVICE
JP61015285	January, 1986	OPTICAL CHARACTER READER
JP62224872	October, 1987	CHARACTER RECOGNITION DEVICE
JP1161575	June, 1989
JP6208650	July, 1994
JP7168909	July, 1995
JP7334610	December, 1995
JP8154163	June, 1996
JP8235316	September, 1996
JP8314495	November, 1996
JP0962773	March, 1997

Primary Examiner:

Desire, Gregory M.

Attorney, Agent or Firm:

Fitzpatrick, Cella, Harper & Scinto

Parent Case Data:

“This application is a Divisional of Ser. No. 09/212,434 filed Dec. 16, 1998 now U.S. Pat. No. 6,891,972”.

Claims:

What is claimed is:

1. A communication system that performs communication between a terminal and a control apparatus, said terminal comprising: input means for inputting image data of a manuscript; character recognition means for performing a character recognition process for the image data input by said input means; first transmitting means for transmitting the character recognition result performed by said character recognition means to said control apparatus; and first receiving means for receiving a control signal transmitted from the control apparatus, the control signal including data for controlling a character recognition process, wherein said character recognition means further performs the character recognition process for the image data input by said input means, on the basis of the control signal received by said first receiving means, and said control apparatus comprising: second receiving means for receiving the character recognition result transmitted from said first transmitting means of said terminal; determining means for automatically determining the control signal based on the character recognition result received by said second receiving means, the control signal including the data for controlling the character recognition process; and second transmitting means for transmitting the control signal determined by said determining means to said first receiving means of said terminal.

2. The communication system according to claim 1, wherein said first transmitting means transmits the character recognition result and information of character recognition areas performed by said character recognition means to said control apparatus, wherein said second receiving means receives the character recognition result and the information of the character recognition areas transmitted from said first transmitting means of said terminal, and wherein said determining means automatically determines the control signal for each recognition areas based on the character recognition result and the information of the character recognition areas received by said second receiving means.

3. The communication system according to claim 2, wherein the character recognition result includes information of unrecognizable character image.

4. The communication system according to claim 1, wherein the character recognition result includes information of unrecognizable character image.

5. The communication system according to claim 4, wherein said determining means determines the control signal based on the number of the unrecognizable character image.

6. The communication system according to claim 4, wherein the information of unrecognizable character image is shown by a predetermined code.

7. The communication system according to claim 1, wherein said character recognition means judges whether each character image included in the image data is unrecognizable by comparing similarity value of recognition candidate character corresponding to the character image with a threshold value.

8. The communication system according to claim 7, wherein the threshold value is determined by the control signal.

9. A control apparatus that performs communication with a terminal, said terminal comprising: input means for inputting image data of a manuscript; character recognition means for performing a character recognition process for the image data input by said input means; first transmitting means for transmitting the character recognition result performed by said character recognition means to said control apparatus; and first receiving means for receiving a control signal transmitted from the control apparatus, the control signal including data for controlling a character recognition process, wherein said character recognition means further performs the character recognition process for the image data input by said input means, on the basis of the control signal received by said first receiving means, and said control apparatus comprising: second receiving means for receiving the character recognition result transmitted from said first transmitting means of said terminal; determining means for automatically determining the control signal based on the character recognition result received by said second receiving means, the control signal including the data for controlling the character recognition process; and second transmitting means for transmitting the control signal determined by said determining means to said first receiving means of said terminal.

10. The control apparatus according to claim 9, wherein said first transmitting means transmits the character recognition result and information of character recognition areas performed by said character recognition means to said control apparatus, wherein said second receiving means receives the character recognition result and the information of the character recognition areas transmitted from said first transmitting means of said terminal, and wherein said determining means automatically determines the control signal for each recognition areas based on the character recognition result and the information of the character recognition areas received by said second receiving means.

11. A terminal that performs communication with a control apparatus, said terminal comprising: input means for inputting image data of a manuscript; character recognition means for performing a character recognition process for the image data input by said input means; first transmitting means for transmitting the character recognition result performed by said character recognition means to said control apparatus; and first receiving means for receiving a control signal transmitted from the control apparatus, the control signal including data for controlling a character recognition process, wherein said character recognition means further performs the character recognition process for the image data inputted by said input means, on the basis of the control signal received by said first receiving means, and said control apparatus comprising: second receiving means for receiving the character recognition result transmitted from said first transmitting means of said terminal; determining means for automatically determining the control signal based on the character recognition result received by said second receiving means, the control signal including the data for controlling the character recognition process; and second transmitting means for transmitting the control signal determined by said determining means to said first receiving means of said terminal.

12. A control method for a communication system that performs communication between a terminal and a control apparatus, comprising: an input step of inputting image data of a manuscript; a character recognition step of performing a character recognition process for the image data input in said input step; a first transmitting step of transmitting the character recognition result performed in said character recognition step from the terminal to the control apparatus; a first receiving step of receiving a control signal transmitted from the control apparatus, the control signal including data for controlling a character recognition process, wherein said character recognition step further performs the character recognition process for the image data input in said input step, on the basis of the control signal received in said first receiving step; a second receiving step of receiving the character recognition result transmitted from the terminal to the control apparatus, a determining step of automatically determining the control signal based on the character recognition result received in said second receiving step, the control signal including the data for controlling the character recognition process; and a second transmitting step of transmitting the control signal determined in said determining step to a first receiving means of said terminal.

13. The control method for a communication system according to claim 12, further comprising: a first transmitting step of transmitting the character recognition result and information of character recognition areas performed in said character recognition step from the terminal to the control apparatus; and a second receiving step of receiving the character recognition result and the information of the character recognition areas transmitted from said the terminal to the control apparatus, wherein said determining step automatically determines the control signal for each recognition areas based on the character recognition result and the information of the character recognition areas received in said second receiving step.

14. The control method for a communication system according to claim 13, wherein the character recognition result includes information of unrecognizable character image.

15. The control method for a communication system according to claim 12, wherein the character recognition result includes information of unrecognizable character image.

16. The control method for a communication system according to claim 15, wherein said determining step determines the control signal based on the number of the unrecognizable character image.

17. The control method for a communication system according to claim 15, wherein the information of unrecognizable character image is shown by a predetermined code.

18. The control method for a communication system according to claim 12, wherein said character recognition step judges whether each character image included in the image data is unrecognizable by comparing similarity value of recognition candidate character corresponding to the character image with a threshold value.

19. The control method for a communication system according to claim 18, wherein the threshold value is determined by the control signal.

20. A control method for a control apparatus that performs communication with a terminal performing by said terminal: an input step of inputting image data of a manuscript; a character recognition step of performing a character recognition process for the image data input by said input step; a first transmitting step of transmitting the character recognition result performed by said character recognition step to said control apparatus; and first receiving step for receiving a control signal transmitted from the control apparatus, the control signal including data for controlling a character recognition process, wherein said character recognition step further performs the character recognition process for the image data input by said input step, on the basis of the control signal received by said first receiving step, and performing by said apparatus: a second receiving step of receiving the character recognition result transmitted from said first transmitting step of said terminal; a determining step for automatically determining the control signal based on the character recognition result received by said second receiving step, the control signal including the data for controlling the character recognition process; and second transmitting step of transmitting the control signal determined by said determining step to said first receiving step of said terminal.

21. The control method for a control apparatus according to claim 20, wherein said first transmitting step transmits the character recognition result and information of character recognition areas performed in said character recognition step to said control apparatus, wherein said second receiving step receives the character recognition result and the information of the character recognition areas transmitted from said terminal, and wherein said determining step automatically determines the control signal for each recognition areas based on the character recognition result and the information of the character recognition areas received in said second receiving step.

22. A control method for a terminal that performs communication with a control apparatus, comprising: performing by said terminal: an input step of inputting image data of a manuscript; a character recognition step of performing a character recognition process for the image data input in said input step; a first transmitting step of transmitting the character recognition result performed in said character recognition step to said control apparatus; and a first receiving step of receiving a control signal transmitted from the control apparatus, the control signal including data for controlling a character recognition process, wherein said character recognition step further performs the character recognition process for the image data inputted in said input step, on the basis of the control signal received in said first receiving step; and performing by said control apparatus: a second receiving step of receiving the character recognition result transmitted from said first transmitting means of said terminal; a determining step of automatically determining the control signal based on the character recognition result received in said second receiving step, the control signal including the data for controlling the character recognition process; and a second transmitting step of transmitting the control signal determined in said determining step to said terminal.

23. A computer-readable memory that stores program code for controlling a communication system that performs communication between a terminal and a control apparatus, said program comprising: program code for an input step of inputting image data of a manuscript using the terminal; program code for a character recognition step for the image data input in said input step; program code for a first transmitting step of transmitting the character recognition result performed in said character recognition step to said control apparatus; program code for a first receiving step of receiving a control signal transmitted from the control apparatus to the terminal, the control signal including data for controlling a character recognition process, wherein said character recognition step further performs the character recognition process for the image data inputted in said input step using the terminal, on the basis of the control signal received in said first receiving step; program code for a second receiving step of receiving the character recognition result transmitted said first transmitting means of said terminal; program code for a determining step of automatically determining the control signal based on the character recognition result received in said second receiving step, the control signal including the data for controlling the character recognition process; and program code for a second transmitting step of transmitting the control signal determined in said determining step from the control apparatus to the terminal.

24. A computer-readable memory that stores program code for controlling a control apparatus that performs communication with a terminal, wherein said terminal comprises: program code for an input step of inputting image data of a manuscript; program code for a character recognition step of performing a character recognition step for the image data input in said input step; program code for a first transmitting step of transmitting the character recognition result performed in said character recognition step to said control apparatus; program code for a first receiving step of receiving a control signal transmitted from the control apparatus, the control signal including data for controlling a character recognition process, wherein said character recognition step further performs the character recognition process for the image data inputted in said input step, on the basis of the control signal received in said first receiving step; and wherein said control apparatus comprises: program code for a determining step of determining the control signal, the control signal including the data for controlling the character recognition process; and program code for a second transmitting step of transmitting the control signal determined in said determining step to said terminal.

25. A computer-readable memory that stores program code for controlling a terminal that performs communication with a control apparatus, comprising: performing by said terminal: program code for an input step of inputting image data of a manuscript; program code for a character recognition step of performing a character recognition process for the image data input in said input step; program code for a first transmitting step of transmitting the character recognition result performed in said character recognition step to said control apparatus; and program code for a first receiving step of receiving a control signal transmitted from the control apparatus, the control signal including data for controlling a character recognition process, wherein said character recognition step further performs the character recognition process for the image data inputted in said input step, on the basis of the control signal received in said first receiving step; and performing by said control apparatus: program code for a second receiving step of receiving the character recognition result transmitted from said first transmitting means of said terminal; program code for a determining step of automatically determining the control signal based on the character recognition result received in said second receiving step, the control signal including the data for controlling the character recognition process; and program code for a second transmitting step of transmitting the control signal determined in said determining step to said terminal.

Description:

BACKGROUND OF THE INVENTION

The present invention relates to a communication system, which performs communication between a terminal and a central control unit, and a control method thereof, and computer-readable memory.

Generally speaking, a terminal having a character recognition unit transfers the result of character recognition in the terminal to a central control unit, and the central control unit performs post-processing such as error correction, search, and storage of the result of character recognition. At this time, if the terminal judges that the accuracy of a candidate for character recognition is low, the terminal informs the central control unit of being unrecognizable by sending a predetermined identifier (hereinafter, this is called a rejection code) to the central control unit as the candidate for character recognition being unrecognizable.

As for the rejection code, probability (hereinafter, this is called similarity) of each recognition candidate character is calculated, and if it is lower than a predetermined threshold, it is judged that the character is unrecognizable. Therefore, as shown in FIG. 17, generally speaking, if frequency of the rejection code (hereinafter, this is called a rejection ratio) is high, that is, if a threshold of the similarity is high, the similarity of the character that is judged to be recognizable becomes relatively high and its correct solution ratio becomes also high. On the contrary, if the rejection ratio is low, the correct solution ratio of the character is apt to be low even if it is judged that the character is recognizable.

Nevertheless, in a communication system that performs communication between the conventional terminal and central control unit, the rejection ratio is inherent, that is, the threshold of the similarity is fixed. Owing to this, for example, if the rejection ratio varies due to a state change of character recognition in each terminal, the central control unit can treat nothing against that, and hence it is inevitable that efficiency of post-processing decrease.

SUMMARY OF THE INVENTION

The present invention is invented in consideration of the above problems, and an object thereof is to provide a communication system and a control method thereof, which increase processing efficiency in a communication system that performs communication between a terminal, performing character recognition, and a central control unit, and computer-readable memory.

A communication system according to the present invention for achieving the above object comprises the following construction. Thus, the communication system performs communication between a terminal and a central control unit, the terminal comprising:

- read means for reading a manuscript as image data;
- character recognition means for performing character recognition from the image data, read by the read means, on the basis of a control signal; and
- first communication means for transmitting a result of character recognition in the character recognition means to the central control unit or receiving the control signal from the central control unit;
- the central control unit comprising:
- second communication means for receiving the result of character recognition in the character recognition means from the terminal or transmitting the control signal to the terminal; and
- control means for controlling the control signal on the basis of the result of character recognition in the character recognition means, which the second communication means receives.

A control method for a communication system according to the present invention for achieving the above object comprises the following construction. Thus, the control method is for a communication system that performs communication between a terminal and a central control unit, the control method comprising:

- a read step of reading a manuscript as image data;
- a character recognition step of performing character recognition from the image data, read at the read step, on the basis of a control signal;
- a first communication step of transmitting a result of character recognition at the character recognition step to the central control unit or receiving the control signal from the central control unit;
- a second communication step of receiving the result of character recognition at the character recognition step from the terminal or transmitting the control signal to the terminal; and
- a control step of controlling the control signal on the basis of the result of character recognition at the character recognition step, which the second communication step receives.

Computer-readable memory according to the present invention for achieving the above object comprises the following construction. Thus, the computer-readable memory stores program code for controlling a communication system that performs communication between a terminal and a central control unit, the computer-readable memory comprising:

- program code for a read step of reading a manuscript as image data;
- program code for a character recognition step of performing character recognition from the image data, read at the read step, on the basis of a control signal;
- program code for a first communication step of transmitting a result of character recognition at the character recognition step to the central control unit or receiving the control signal from the central control unit;
- program code for a second communication step of receiving the result of character recognition at the character recognition step from the terminal or transmitting the control signal to the terminal; and
- program code for a control step of controlling the control signal on the basis of the result of character recognition at the character recognition step, which the second communication step receives.

- read means for reading a manuscript, including a manuscript ID showing a kind of the manuscript, as image data;
- storage means for storing a recognition dictionary group each corresponding to an attribute of data;
- character recognition means for performing character recognition from the image data, read by the read means, with selecting a recognition dictionary, based on a control signal, from the recognition dictionary group stored in the storage means;
- manuscript ID recognition means for recognizing the manuscript ID from the image data; and
- first communication means for transmitting a result of character recognition in the character recognition means and a result of manuscript ID recognition in the manuscript ID recognition means to the central control unit or receiving the control signal from the central control unit;
- the central control unit comprising:
- second communication means for receiving the result of character recognition in the character recognition means and the result of manuscript ID recognition in the manuscript ID recognition means from the terminal or transmitting the control signal to the terminal; and
- control means for controlling the control signal on the basis of the result of manuscript ID recognition in the manuscript ID recognition means, which the second communication means receives.

- a read step of reading a manuscript, including a manuscript ID showing a kind of the manuscript, as image data;
- a character recognition step of performing character recognition from the image data, read at the read step, with selecting a recognition dictionary, based on a control signal, from a recognition dictionary group whose members each correspond to each attribute of data;
- a manuscript ID recognition step of recognizing the manuscript ID from the image data;
- a first communication step of transmitting a result of character recognition at the character recognition step and a result of manuscript ID recognition at the manuscript ID recognition step to the central control unit or receiving the control signal from the central control unit;
- a second communication step of receiving the result of character recognition at the character recognition step and the result of manuscript ID recognition at the manuscript ID recognition step from the terminal or transmitting the control signal to the terminal; and
- a control step of controlling the control signal on the basis of the result of manuscript ID recognition at the manuscript ID recognition step, which the second communication step receives.

- program code for a read step of reading a manuscript, including a manuscript ID showing a kind of the manuscript, as image data;
- program code for a character recognition step of performing character recognition from the image data, read at the read step, with selecting a recognition dictionary from a recognition dictionary group whose members each correspond to each attribute of data, on the basis of a control signal;
- program code for a manuscript ID recognition step of recognizing the manuscript ID from the image data;
- program code for a first communication step of transmitting a result of character recognition at the character recognition step and a result of manuscript ID recognition at the manuscript ID recognition step to the central control unit or receiving the control signal from the central control unit;
- program code for a second communication step of receiving the result of character recognition at the character recognition step and the result of manuscript ID recognition at the manuscript ID recognition step from the terminal or transmitting the control signal to the terminal; and
- program code for a control step of controlling the control signal on the basis of the result of manuscript ID recognition at the manuscript ID recognition step, which the second communication step receives.

- read means for reading a manuscript as image data;
- character recognition means for performing character recognition from the image data, read by the read means, on the basis of a control signal; and
- first communication means for transmitting a result of character recognition in the character recognition means to the central control unit or receiving the control signal from the central control unit;
- the central control unit comprising:
- input means for inputting the control signal; and
- second communication means for receiving the result of character recognition in the character recognition means from the terminal or transmitting the control signal, which is inputted from the input means, to the terminal.

A control method of a communication system according to the present invention for achieving the above object comprises the following construction. Thus, the control method is for a communication system that performs communication between a terminal and a central control unit, the control method comprising:

- a read step of reading a manuscript as image data;
- a character recognition step of performing character recognition from the image data, read at the read step, on the basis of a control signal;
- a first communication step of transmitting a result of character recognition at the character recognition step to the central control unit or receiving the control signal from the central control unit;
- an input step of inputting the control signal; and
- a second communication step of receiving the result of character recognition at the character recognition step from the terminal or transmitting the control signal, which is inputted at the input step, to the terminal.

- program code for a read step of reading a manuscript as image data;
- program code for a character recognition step of performing character recognition from the image data, read at the read step, on the basis of a control signal;
- program code for a first communication step of transmitting a result of character recognition at the character recognition step to the central control unit or receiving the control signal from the central control unit;
- program code for an input step of inputting the control signal; and
- program code for a second communication step of receiving the result of character recognition at the character recognition step from the terminal or transmitting the control signal, which is inputted at the input step, to the terminal.

- read means for reading a manuscript, including a manuscript ID showing a kind of the manuscript, as image data;
- character recognition means for performing character recognition from the image data, read by the read means, on the basis of a control signal;
- manuscript ID recognition means for recognizing the manuscript ID from the image data; and
- first communication means for transmitting a result of character recognition in the character recognition means and a result of manuscript ID recognition in the manuscript ID recognition means to the central control unit or receiving the control signal from the central control unit;
- the central control unit comprising:
- second communication means for receiving the result of character recognition in the character recognition means and the result of manuscript ID recognition in the manuscript ID recognition means from the terminal or transmitting the control signal to the terminal; and
- control means for controlling the control signal on the basis of the result of manuscript ID recognition in the manuscript ID recognition means, which the second communication means receives.

A control method of the communication system according to the present invention for achieving the above object comprises the following construction. Thus, the control method is for a communication system that performs communication between a terminal and a central control unit, the control method comprising:

- a read step of reading a manuscript, including a manuscript ID showing a kind of the manuscript, as image data;
- a character recognition step of performing character recognition from the image data, read at the read step, on the basis of a control signal;
- a manuscript ID recognition step of recognizing the manuscript ID from the image data; and
- a first communication step of transmitting a result of character recognition at the character recognition step and a result of manuscript ID recognition at the manuscript ID recognition step to the central control unit or receiving the control signal from the central control unit;
- a second communication step of receiving the result of character recognition at the character recognition step and the result of manuscript ID recognition at the manuscript ID recognition step from the terminal or transmitting the control signal to the terminal; and
- a control step of controlling the control signal on the basis of the result of manuscript ID recognition at the manuscript ID recognition step, which the second communication step receives.

- program code for a read step of reading a manuscript, including a manuscript ID showing a kind of the manuscript, as image data;
- program code for a character recognition step of performing character recognition from the image data, read at the read step, on the basis of a control signal;
- program code for a manuscript ID recognition step of recognizing the manuscript ID from the image data; and
- program code for a first communication step of transmitting a result of character recognition at the character recognition step and a result of manuscript ID recognition at the manuscript ID recognition step to the central control unit or receiving the control signal from the central control unit;
- program code for a second communication step of receiving the result of character recognition at the character recognition step and the result of manuscript ID recognition at the manuscript ID recognition step from the terminal or transmitting the control signal to the terminal; and
- program code for a control step of controlling the control signal on the basis of the result of manuscript ID recognition at the manuscript ID recognition step, which the second communication step receives.

- read means for reading a manuscript as image data;
- character recognition means for dividing the image data, read by the read means, into recognition areas each having the same attribute and performing character recognition on the basis of a control signal corresponding to each recognition area being divided; and
- first communication means for transmitting positional information, showing the recognition areas respectively, and a result of character recognition every recognition area to the central control unit or receiving the control signal from the central control unit;
- the central control unit comprising:
- second communication means for receiving the positional information, showing the recognition areas respectively, and the result of character recognition every recognition area from the terminal or transmitting the control signal to the terminal; and
- control means for controlling the control signal every recognition area on the basis of the positional information, showing the recognition areas respectively, and the result of character recognition every recognition area, which the second communication means receives.

- a read step of reading a manuscript as image data;
- a character recognition step of dividing image data, read at the read step, into recognition areas each having the same attribute and performing character recognition on the basis of a control signal corresponding to each recognition area being divided;
- a first communication step of transmitting positional information, showing the recognition areas respectively, and a result of character recognition every recognition area to the central control unit or receiving the control signal from the central control unit;
- a second communication step of receiving the positional information, showing the recognition areas respectively, and the result of character recognition every recognition area from the terminal or transmitting the control signal to the terminal; and
- a control step of controlling the control signal every recognition area on the basis of the positional information, showing the recognition areas respectively, and the result of character recognition every recognition area, which the second communication step receives.

- program code for a read step of reading a manuscript as image data;
- program code for a character recognition step of dividing the image data, read at the read step, into recognition areas each having the same attribute and performing character recognition on the basis of a control signal corresponding to each recognition area being divided;
- program code for a first communication step of transmitting positional information, showing the recognition areas respectively, and a result of character recognition every recognition area to the central control unit or receiving the control signal from the central control unit;
- program code for a second communication step of receiving the positional information, showing the recognition areas respectively, and the result of character recognition every recognition area from the terminal or transmitting the control signal to the terminal; and
- program code for a control step of controlling the control signal every recognition area on the basis of the positional information, showing the recognition areas respectively, and the result of character recognition every recognition area, which the second communication step receives.

- read means for reading a manuscript as image data;
- character recognition means for performing character recognition from the image data read by the read means; and
- first communication means for transmitting a result of character recognition in the character recognition means to the central control unit;
- the central control unit comprising:
- second communication means for receiving the result of character recognition in the character recognition means from the terminal;
- display means for displaying the result of character recognition in the character recognition means, which the second communication means receives;
- input means for inputting an instruction for performing processing of the result of character recognition; and
- post-processing means for performing post-processing of the result of character recognition on the basis of the input with the input means.

- a read step of reading a manuscript as image data;
- a character recognition step of performing character recognition from the image data read at the read step;
- a first communication step of transmitting a result of character recognition at the character recognition step to the central control unit;
- a second communication step of receiving the result of character recognition at the character recognition step from the terminal;
- a display step for displaying the result of character recognition at the character recognition step, which is received at the second communication step;
- an input step of inputting an instruction for performing processing of the result of character recognition; and
- a post-processing step for performing post-processing of the result of character recognition on the basis of the input at the input step.

- program code for a read step of reading a manuscript as image data;
- program code for a character recognition step of performing character recognition from the image data read at the read step;
- program code for a first communication step of transmitting a result of character recognition at the character recognition step to the central control unit;
- program code for a second communication step of receiving the result of character recognition at the character recognition step from the terminal;
- program code for a display step for displaying the result of character recognition at the character recognition step, which is received at the second communication step;
- program code for an input step of inputting an instruction for performing processing of the result of character recognition; and
- program code for a post-processing step for performing post-processing of the result of character recognition on the basis of the input at the input step.

Other features and advantages of the present invention will be apparent from the following description taken in conjunction with the accompanying drawings, in which like reference characters designate the same or similar parts throughout the figures thereof.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.

FIG. 1 is a block diagram showing the construction of a communication system of a first embodiment according to the present invention;

FIG. 2 is a flow chart showing processing executed in a character recognition block of the first embodiment according to the present invention;

FIG. 3 is a flow chart showing processing executed in a threshold controller of the first embodiment according to the present invention;

FIG. 4 is a block diagram showing the construction of a communication system of a second embodiment according to the present invention;

FIG. 5 is a flow chart showing processing executed in a character recognition block of the second embodiment according to the present invention;

FIG. 6 is a flow chart showing processing executed in a recognition dictionary information setting block of the second embodiment according to the present invention;

FIG. 7 is a block diagram showing the construction of a communication system of a third embodiment according to the present invention;

FIG. 8 is a block diagram showing the construction of a communication system of a fourth embodiment according to the present invention;

FIG. 9 is a flow chart showing processing executed in a character recognition block of the fourth embodiment according to the present invention;

FIG. 10 is a flow chart showing processing executed in a threshold controller of the fourth embodiment according to the present invention;

FIG. 11 is a block diagram showing the construction of a communication system of a fifth embodiment according to the present invention;

FIG. 12 is a flow chart showing processing executed in a character recognition block of the fifth embodiment according to the present invention;

FIG. 13 is a flow chart showing processing executed in a threshold controller of the fifth embodiment according to the present invention;

FIG. 14 is a block diagram showing the construction of a communication system of a sixth embodiment according to the present invention;

FIG. 15 is a flow chart showing processing executed in a character recognition block of the sixth embodiment according to the present invention;

FIG. 16 is a flow chart showing processing executed in a character recognition result post-processor of the sixth embodiment according to the present invention; and

FIG. 17 is a graph showing the relationship between the rejection ratio and accuracy of recognized character.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Preferred embodiments of the present invention will be described in detail with reference to drawings.

Embodiment 1

FIG. 1 is a block diagram showing the construction of a communication system of a first embodiment according to the present invention.

As shown in FIG. 1, the communication system is composed of a mobile terminal 100 and a central control unit 200. In addition, the mobile terminal 100 and central control unit 200 are connected via a wireless network 300. Furthermore, here, one mobile terminal 100 and one central control unit 200 constructs the communication system, but the first embodiment can be also applied to a case of a communication system comprising a plurality of mobile terminals 100. Moreover, in case each mobile terminal of the plurality of mobile terminals 100 communicates with the central control unit 200, the central control unit 200 can identify each mobile terminal by starting communication, for example, after each mobile terminal issuing an identification signal different from others to the central control unit 200.

In a mobile terminal 100, symbol 102 shows a read manuscript. Symbol 104 shows a scanner reading the read manuscript 102 and generating an image signal. Symbol 106 shows a character recognition block performing character recognition of the image signal generated in the scanner 104 with using a recognition dictionary 106a. Symbol 106b shows an unrecognizableness judging block judging whether a character recognition candidate outputted by the character recognition block 106 is unrecognizable, on the basis of a threshold for judgement of unrecognizableness. Symbol 108 shows a character recognition result transmitter transmitting the result of character recognition by the character recognition block 106 to the central control unit 200. Symbol 110 shows a threshold receiver receiving the threshold for judgement of unrecognizableness from the central control unit 200.

In the central control unit 200, symbol 202 shows a character recognition result receiver receiving the result of character recognition from the mobile terminal 100. Symbol 208 is a character recognition result post-processor performing post-processing of the result of character recognition received by the character recognition result receiver 202. Symbol 208a shows a storage block storing data such as processing-result by the character recognition result post-processor 208. Symbol 210 shows a display unit displaying the processing-result by the character recognition result post-processor 208. Symbol 204 shows a threshold controller setting a threshold for judgement of unrecognizableness from the result of character recognition received by the character recognition result receiver 202. Symbol 206 shows a threshold transmitter transmitting the threshold for judgement of unrecognizableness set by the threshold controller 204 to the mobile terminal 100.

In addition, in each of the mobile terminal 100 and central control unit 200, a CPU, RAM, and ROM, which are not shown, are mounted. A CPU mounted in each terminal executes various programs after developing the various programs that are stored in the ROM and are used for controlling equipment. In addition, the RAM also functions as a working area and a temporary save area.

Next, the operation of the communication system of the first embodiment will be described with reference to FIG. 1.

From the read manuscript 102 prepared in the mobile terminal 100, an image signal is generated by the scanner 104. The image signal is sent to the character recognition block 106, where character recognition is performed. The threshold receiver 110 receives the threshold for judgement of unrecognizableness, set in the threshold controller 204 of the central control unit 200, via the wireless network 300. Here, the character recognition block 106 compares the threshold for judgement of unrecognizableness, received by the threshold receiver 110, with similarity of each recognition candidate character. If the similarity of the recognition candidate character is larger than the threshold for judgement of unrecognizableness as a result of the comparison, the character recognition block 106 outputs a character code, corresponding to the recognition candidate character, as a recognition result. On the other hand, if the similarity of the recognition candidate character is less than the threshold for judgement of unrecognizableness, the block 106 outputs a predetermined rejection code as an unrecognizable character. In addition, the detail of the processing executed in the character recognition block 106 will be described later. The character recognition result transmitter 108 transmits a character code, which is the result of character recognition, and a rejection code, which shows unrecognizableness, to the central control unit 200 via the wireless network 300.

On the other hand, in the central control unit 200, first, the character recognition result receiver 202 receives the result of character recognition that is transmitted from the mobile terminal 100. The result of character recognition that is received is corrected by the character recognition result post-processor 208, is stored by the storage block 208a, and is processed like searching data, stored in the storage block 208a, with using the result of character recognition as a key. The processing-result is displayed on the display unit 210. The threshold controller 204 judges a number of results of character recognition that are received by the character recognition result receiver 202, and sets the optimum threshold for judgement of unrecognizableness in the unrecognizable judging block 106 of the mobile terminal 100. In addition, detail of the processing executed in the threshold controller 204 will be described later. The threshold for judgement of unrecognizableness set in the threshold controller 204 is transmitted to the mobile terminal 100 by the threshold transmitter 206 via the wireless network 300.

Next, the processing executed in the first embodiment will be described with reference to FIGS. 2 and 3. In addition, in particular, the processing executed in the character recognition block 106 and threshold controller 204 that are important parts of the first embodiment will be described in detail.

FIG. 2 is a flow chart showing the processing executed in the character recognition block of a first embodiment according to the present invention.

First, at step S300, the character recognition block 106 in the mobile terminal 100 performs character extraction that characters are separated from the image signal inputted from the scanner 104. At step S302, the character recognition block 106 performs predetermined feature extraction from the character image signal separated at the step S300. At step S304, the block 106 calculates the similarity of the image signal of the recognition object character to learned characters in the recognition dictionary 106a on the basis of the feature extracted at the step S302. At step S306, the block 106 selects the predetermined number of recognition candidate characters in the order of their amount, and sorts the recognition candidate characters. Furthermore, this number of recognition candidate characters is set in a number-of-recognition-candidate-characters register (not shown).

At step S308, the block 106 compares the similarity of the first candidate of the recognition candidate characters, that is, the recognition candidate character having the largest similarity, with the threshold for judgement of unrecognizableness with using the unrecognizableness judging block 106b. If the similarity of the first candidate is less than the threshold for judgement of unrecognizableness (NO at the step S308), the process goes to step S310, where a predetermined identifier, that is, a rejection code is outputted with judging the recognition object character as an unrecognizable character. On the other hand, if the similarity of the first candidate is larger than the threshold for judgement of unrecognizableness (YES at the step S308), the process goes to step S312 as successful recognition since it is possible to output at least one result of character recognition.

At the step S312, two is substituted to a number-of-recognition-candidate-characters counter i (not shown) counting the number of the recognition candidate characters processed. At step S314, it is judged whether the content of the number-of-recognition-candidate-characters counter i exceeds the number of recognition candidate characters set in the number-of-recognition-candidate-characters register. If the content of the number-of-recognition-candidate-characters counter i exceeds the number of recognition candidate characters (YES at step S314), the subsequent processing is stopped since there is no recognition candidate character over the number. Then, the process goes to step S316. In addition, at the step S316, all the character codes corresponding to the recognition candidate characters having similarity exceeding the threshold for judgement of unrecognizableness are outputted. On the other hand, if the content of the number-of-recognition-candidate-characters counter i does not exceed the number of recognition candidate characters (NO at the step S314), the process goes to step S318.

At the step S318, the similarity of the ith candidate is compared with the threshold for judgement of unrecognizableness. If the similarity of the ith candidate is less than the threshold for judgement of unrecognizableness (NO at the step S318), the ith candidate and subsequent candidates are judged as unrecognizable characters. Then, the process goes to the step S316. On the other hand, if the similarity of the ith candidate is larger than the threshold for judgement of unrecognizableness (YES at the step S318), the process goes to step S320, where the number-of-recognition-candidate-characters counter i is incremented and the process returns to the step S314.

In addition, the number-of-recognition-candidate-characters register and number-of-recognition-candidate-characters counter are implemented, for example, in the RAM mounted in the central control unit 200, or are constructed with dedicated hardware.

Owing to above processing, the rejection ratio judged has the tendency shown in FIG. 17. Thus, if the rejection ratio is high, the correct solution ratio of characters judged as recognizable characters increase, but their number is few. On the contrary, if the rejection ratio is low, the number of characters judged as recognizable characters is large, but the correct solution ratio of the characters also decreases. Then, in the first embodiment, in order that character recognition in the mobile terminal 100 may be executed at an optimum rejection ratio, the threshold controller 104 of the central control unit 200 resets the threshold for judgement of unrecognizableness according to a judgement state of the unrecognizableness judging block 106b of the mobile terminal 100.

FIG. 3 is a flow chart showing the processing executed in the threshold controller of the first embodiment of the present invention.

At step S402, on the basis of the result of character recognition received by the character recognition result receiver 202, it is judged whether the number of unrecognizable characters (rejection codes) per read manuscript is not less than the first threshold TH1. If the number of unrecognizable characters is not less than the first threshold TH1 (YES at the step S402), the controller 104 judges that the read condition of the read manuscript on the scanner 104 of the mobile terminal 100 becomes worse due to some reason. Then, the process goes to step S406. In addition, at the step S406, so as to increase the number of recognizable characters, the controller 104 resets the threshold for judgement of unrecognizableness to a value less than the current threshold for judgement of unrecognizableness that is set in the unrecognizableness judging block 106b of the mobile terminal 100. After that, the process is ended.

On the other hand, if the number of unrecognizable characters is less than the first threshold TH1 (NO at the step S402), the process goes to step S404. At the step S404, it is judged whether the number of unrecognizable characters is less than the second threshold TH2 (<TH1). If the number of unrecognizable characters is less than the second threshold TH2 (YES at the step S404), the controller 104 judges that the correct solution ratio of the result of character recognition becomes worse, and the process goes to step S408. Then, at the step S408, so as to increase the correct solution ratio of recognition results, the controller 104 resets the threshold for judgement of unrecognizableness to a value that is larger than the current threshold for judgement of unrecognizableness that is set in the unrecognizableness judging block 106b of the mobile terminal 100. After that, the process is ended.

On the other hand, if the number of unrecognizable characters is not less than the second threshold TH2 (NO at the step S404), the controller 104 judges that the current threshold for judgement of unrecognizableness is adequate, and ends the processing.

As described above, according to the first embodiment, it is possible to always obtain the result of character recognition having the optimum accuracy by an operator judging the character recognition state of each mobile terminal 100 in the central control unit 200 and adaptively controlling the threshold for judgement of unrecognizableness used for judgement in the unrecognizableness judging block 106b of the mobile terminal 100. In particular, in case that the recognition state in the mobile terminal 100 side changes every moment, the present invention can largely contribute to making the character recognition processing of the mobile terminal 100 efficient.

Although, in the first embodiment, the number of recognition candidate characters that the character recognition block 106 of the mobile terminal 100 outputs is plural, the present invention is not limited to this. For example, with selecting a recognition candidate character having the largest similarity as only one recognition candidate character, the unrecognizableness judging block 106b can perform judgement. In this case, it becomes possible to accelerate the processing.

Although, in the first embodiment, the communication system composed of the mobile terminal 100 and central control unit 200 that are connected via the wireless network 300 is described, the present invention is not limited to this. For example, there is no problem even if a communication system is composed of terminals and a central control unit 200 that are connected via a wired network, internet, intranet, and etc.

Embodiment 2

FIG. 4 is a block diagram showing the construction of a communication system of a second embodiment according to the present invention.

As shown in FIG. 4, the communication system is composed of a mobile terminal 120 and a central control unit 220. In addition, the mobile terminal 120 and central control unit 220 are connected via a wireless network 320. Furthermore, here, one mobile terminal 120 and one central control unit 220 constructs the communication system, but the second embodiment can be also applied to a case of a communication system comprising a plurality of mobile terminals 120. Moreover, in case each mobile terminal of the plurality of mobile terminals 120 communicates with the central control unit 220, the central control unit 220 can identify each mobile terminal by starting communication, for example, after each mobile terminal issuing an identification signal different from others to the central control unit 220.

In a mobile terminal 120, symbol 122 shows a read manuscript. In addition, for example, a manuscript ID showing recognition position information of recognition areas that are classified every character font constructed in the read manuscript is added to the read manuscript 122. Symbol 124 shows a scanner reading the read manuscript 122 and generating an image signal including the manuscript ID. Symbol 126 shows a character recognition block performing character recognition every recognition area of the image signal generated in the scanner 124 with selecting a recognition dictionary, which is shown by recognition dictionary information, from a recognition dictionary group 126a on the basis of the recognition dictionary information and positional information that is received by a recognition dictionary information & positional information receiver 121. Symbol 127 shows a manuscript ID recognition block recognizing a manuscript ID in the image signal generated. Symbol 128 shows a character recognition result & manuscript ID transmitter transmitting the result of character recognition by the character recognition block 126 and the result of manuscript ID recognition by the manuscript ID recognition block 127 to the central control unit 220. Symbol 121 shows the recognition dictionary information & positional information receiver receiving the positional information showing a recognition area of the image signal and the recognition dictionary information showing a recognition dictionary used for recognition of the recognition area from the central control unit 220.

In the central control unit 220, symbol 222 shows a character recognition result & manuscript ID receiver receiving the result of character recognition and the result of manuscript ID recognition from the mobile terminal 120. Symbol 228 is a character recognition result post-processor performing post-processing of the result of character recognition received by the character recognition result & manuscript ID receiver 222. Symbol 228a shows a storage block storing data such as processing-result by the character recognition result post-processor 228. Symbol 223 shows a display unit displaying processing-result by the character recognition result post-processor 228. Symbol 224 shows a recognition dictionary setting block setting the recognition dictionary information, showing a recognition dictionary for each recognition area in the image signal of a recognition object, from the result of manuscript ID recognition received by the character recognition result & manuscript ID receiver 222 with referring to a recognition dictionary information database 224a. The symbol 224a shows the recognition dictionary information database managing recognition dictionary information, showing a recognition dictionary optimum for recognition of the recognition area, every image signal shown by the manuscript ID. Symbol 226 shows a recognition dictionary information & positional information transmitter transmitting positional information and recognition dictionary information of each recognition area in the image signal, which is set in the recognition dictionary setting block 224, to the mobile terminal 120.

In addition, in each of the mobile terminal 120 and central control unit 220, a CPU, RAM, and ROM, which are not shown, are mounted. A CPU mounted in each terminal executes various programs after developing the various programs that are stored in the ROM and is used for controlling equipment. In addition, the RAM also functions as a working area and a temporary save area.

Next, the operation of the communication system of the second embodiment will be described with reference to FIG. 4.

From the read manuscript 122 prepared in the mobile terminal 120, an image signal including a manuscript ID corresponding to the read manuscript 122 is generated by the scanner 124. The image signal is sent to the character recognition block 126, where character recognition is performed. The recognition dictionary information & positional information receiver 121 receives positional information and recognition dictionary information of each recognition area in the image signal of a recognition object, which is set in the recognition dictionary information setting block 224 of the central control unit 220, via the wireless network 320. Here, the character recognition block 126 compares similarity of recognition candidate characters in each recognition area with using a recognition dictionary shown by the recognition dictionary information for each recognition area in the image signal received by the recognition dictionary information & positional information receiver 121. Then, on the basis of the comparison result, the character recognition block 126 outputs a recognition result. In addition, detailed processing executed in the character recognition block 126 will be described later. The character recognition result & manuscript ID transmitter 128 transmits a character code, which is the result of character recognition by the character recognition block 126, and the result of manuscript ID recognition by the manuscript ID recognition block 127, to the central control unit 220 via the wireless network 320.

On the other hand, in the central control unit 220, first, the character recognition result & manuscript ID receiver 222 receives the result of character recognition and the result of manuscript ID recognition that are transmitted from the mobile terminal 120. The result of character recognition received is corrected by the character recognition result post-processor 228, is stored by the storage block 228a, and is processed like searching data, stored in the storage block 228a, with using the result of character recognition as a key. The processing-result is displayed on the display unit 223. The recognition dictionary information setting block 224 sets recognition dictionary information, showing a recognition dictionary optimum for each recognition area in the image signal of the recognition object, on the basis of the result of manuscript ID recognition which is received, with referring to the recognition dictionary information database 224a. Furthermore, the positional information every recognition area is also obtained. In addition, the processing executed in the recognition dictionary information setting block 224 will be described later in detail. The recognition dictionary information and positional information of each recognition area in the image signal of the recognition object, which is set in the recognition dictionary information setting block 224 is transmitted to the mobile terminal 120 by the recognition dictionary information & positional information transmitter 226 via the wireless network 320.

Next, the processing executed in the second embodiment will be described with reference to FIGS. 5 and 6. In addition, here, in particular, the processing executed in the character recognition block 126 and recognition dictionary information setting block 224 that are important parts of the present invention will be described in detail.

FIG. 5 is a flow chart showing the processing executed in the character recognition block of a second embodiment according to the present invention.

First, at step S320, the character recognition block 126 performs character extraction that characters are separated from the image signal inputted from the scanner 124. At step S321, the manuscript ID recognition block 127 recognizes a manuscript ID included in the image signal inputted. Then, the manuscript ID recognition block 127 judges on the basis of the manuscript ID, which is recognized, a recognition area where the character that is extracted at the step S320 belongs among the recognition areas of the image signal. At step S322, the character recognition block 126 performs predetermined feature extraction from the character extracted at the step S320. At step S324, the block 126 calculates the similarity of the recognition object character to learned characters in the recognition dictionary 126a every recognition area on the basis of the feature extracted at the step S322. At step S326, the block 126 selects the predetermined number of recognition candidate characters in the order of their amount, and sorts the recognition candidate characters. At step S328, all the character codes corresponding to recognition candidate characters are outputted.

FIG. 6 is a flow chart showing the processing executed in the recognition dictionary information setting block of the second embodiment of the present invention.

At step 420, the manuscript ID of the image signal of the recognition object is judged according to the result of manuscript ID recognition received in the character recognition result & manuscript ID receiver 222. At step S422, data (recognition dictionary information and positional information of each recognition area of the image signal of the recognition object) corresponding to the manuscript ID judged at the step S420 is obtained from the recognition dictionary information database 224a.

As described above, according to the second embodiment, it is possible to increase recognition accuracy in each recognition area. This is because the central control unit 220 can set a recognition dictionary optimum for each recognition area of the image signal inputted in the mobile terminal 120, on the basis of the result of manuscript ID recognition inputted from the mobile terminal 120. In particular, in case that characters whose writers are different or different fonts are mixed, or a format of a read manuscript changes in the same read manuscript, the present invention can perform excellently accurate character recognition of the read manuscript, and can largely increase the efficiency of processing.

Although, in the second embodiment, the communication system composed of the mobile terminal 120 and central control unit 220 that are connected via the wireless network 320 is described, the second embodiment is not limited to this. For example, there is no problem even if a communication system is composed of terminals and a central control unit 220 that are connected via a wired network, internet, intranet and etc.

Embodiment 3

A third embodiment is a modified example of the first embodiment. The construction different from that of the first embodiment is new provision of a threshold input block 234, which enables a user to input an optional threshold, instead of the threshold controller 204.

FIG. 7 is a block diagram showing the construction of a communication system of the third embodiment according to the present invention.

Symbol 234 shows the threshold input block inputting a threshold for judgement of unrecognizableness. In the threshold input block 234, an operator determines an optimum threshold for judgement of unrecognizableness on the basis of the processing result obtained by the character recognition result post-processor 208, and inputs the optimum threshold. In addition, the processing executed in the threshold input block 234 will be described later in detail. The threshold for judgement of unrecognizableness that is inputted from the threshold input block 234 is transmitted to the mobile terminal 100 by the threshold transmitter 210 via the wireless network 300.

Next, as the processing executed in the third embodiment, the processing similar to that of the first embodiment in FIG. 2 is executed. Then, owing to the processing described in FIG. 2, the rejection ratio judged has the tendency shown in FIG. 17. Thus, if the rejection ratio is high, the correct solution ratio of characters judged as recognizable characters increase, but their number is few. On the contrary, if the rejection ratio is low, the number of characters judged as recognizable characters is many, but the correct solution ratio of the characters also decreases. Then, in the third embodiment, in order that character recognition in the mobile terminal 100 may be executed at an optimum rejection ratio, the threshold input block 234 of the central control unit 200 resets the threshold for judgement of unrecognizableness according to a judgement state of the unrecognizableness judging block 106b of the mobile terminal 100.

Concretely, the threshold for judgement of unrecognizableness in the unrecognizableness judging block 106b of the mobile terminal 100 is changed from the threshold input block 234 of the central control unit 200.

Thus, an operator in the central control unit 200 judges that the accuracy of the result of character recognition transmitted from the mobile terminal 100 is hard or it is necessary to reduce the character recognition accuracy a little bit if, for example, the operator judges that the number of unrecognizable characters per read manuscript in a mobile terminal 100 is extremely many. Then, the operator inputs a threshold for judgement of unrecognizableness, which is lower than the current threshold for judgement of unrecognizableness, from the threshold input block 234. Furthermore, the threshold transmitter 210 transmits the threshold for judgement of unrecognizableness to the corresponding mobile terminal 100, and the operator controls this system so as to be able to receive further plenty of normal recognition results. On the other hand, if the operator judges that the number of unrecognizable characters per read manuscript is few, the operator judges that the accuracy of the result of character recognition transmitted from the mobile terminal 100 becomes worse or there is a space for further increasing the character recognition accuracy. Then, the operator inputs a threshold for judgement of unrecognizableness, which is higher than the current threshold for judgement of unrecognizableness, from the threshold input block 234. Furthermore, the threshold transmitter 210 transmits the threshold for judgement of unrecognizableness to the corresponding mobile terminal 100.

As described above, according to the third embodiment, it becomes possible to always obtain the result of character recognition having desired accuracy. This is because, in the central control unit 200, an operator judges the result of character recognition in each mobile terminal 100 and inputs a threshold for judgement of unrecognizableness that is used for judgement in the unrecognizableness judging block 106b of the mobile terminal 100. In particular, in case that the recognition state in the mobile terminal 100 changes every moment, the present invention can largely contribute to making the character recognition processing of the mobile terminal 100 efficient.

Although, in the third embodiment, the number of recognition candidate characters that the character recognition block 106 of the mobile terminal 100 outputs is plural, the present invention is not limited to this. For example, with selecting a recognition candidate character having the largest similarity as only one recognition candidate character, the unrecognizableness judging block 106b can perform judgement. In this case, it becomes possible to accelerate the processing.

Although, in the third embodiment, the communication system composed of the mobile terminal 100 and central control unit 200 that are connected via the wireless network 300 is described, the third embodiment is not limited to this. For example, there is no problem even if a communication system is composed of terminals and a central control unit 200 that are connected via a wired network, internet, intranet and etc.

Embodiment 4

FIG. 8 is a block diagram showing the construction of a communication system of a fourth embodiment according to the present invention.

As shown in FIG. 8, the communication system is composed of a mobile terminal 140 and a central control unit 240. In addition, the mobile terminal 140 and central control unit 240 are connected via a wireless network 340. Furthermore, here, one mobile terminal 140 and one central control unit 240 constructs the communication system, but the fourth embodiment can be also applied to a case of a communication system comprising a plurality of mobile terminals 140. Moreover, in case each mobile terminal among the plurality of mobile terminals 140 communicates with the central control unit 240, the central control unit 240 can identify each mobile terminal by starting communication, for example, after each mobile terminal issuing an identification signal different from others to the central control unit 240.

In a mobile terminal 140, symbol 142 shows a read manuscript. In addition, for example, a manuscript ID showing recognition position information of recognition areas that are classified every character font constructed in the read manuscript is added to the read manuscript 142. Symbol 144 shows a scanner reading the read manuscript 142 and generating an image signal including the manuscript ID. Symbol 146 shows a character recognition block performing character recognition of the image signal generated in the scanner 144 with using a recognition dictionary 146a. Symbol 146b shows a unrecognizableness judging block judging whether a recognition candidate character outputted by the character recognition block 146 is unrecognizable, on the basis of a threshold for judgement of unrecognizableness. Symbol 147 shows a manuscript ID recognition block recognizing a manuscript ID in the image signal generated. Symbol 148 shows a character recognition result & manuscript ID transmitter transmitting the result of character recognition by the character recognition block 146 and the result of manuscript ID recognition by the manuscript ID recognition block 147 to the central control unit 240. Symbol 141 shows the threshold & positional information receiver receiving the positional information showing a recognition area of the image signal and a threshold for judgement of unrecognizableness in the recognition area from the central control unit 240.

In the central control unit 240, symbol 242 shows a character recognition result & manuscript ID receiver receiving the result of character recognition and the result of manuscript ID recognition from the mobile terminal 140. Symbol 248 is a character recognition result post-processor performing post-processing of the result of character recognition received by the character recognition result & manuscript ID receiver 242. Symbol 248a shows a storage block storing data such as processing-result by the character recognition result post-processor 248. Symbol 241 shows a display unit displaying processing-result by the character recognition result post-processor 248. Symbol 244 shows a threshold controller setting a threshold for judgement of unrecognizableness in each recognition area in the image signal of the recognition object from the result of manuscript ID recognition received by the character recognition result receiver 242 with referring to a threshold database 244a. The symbol 244a shows the threshold database managing an optimum threshold for judgement of unrecognizableness in a recognition area of each image signal every image signal shown by the manuscript ID every read manuscript. Symbol 246 shows a threshold & positional information transmitter transmitting positional information of each recognition area in the image signal, which is set in the threshold controller 244, and a threshold for judgement of unrecognizableness of each recognition area to the mobile terminal 140.

In addition, in each of the mobile terminal 140 and central control unit 240, a CPU, RAM, and ROM, which are not shown, are mounted. A CPU mounted in each terminal executes various programs after developing the various programs which are stored in the ROM and is used for controlling equipment. In addition, the RAM also functions as a working area and a temporary save area.

Next, the operation of the communication system of the fourth embodiment will be described with reference to FIG. 8.

From the read manuscript 142 prepared in the mobile terminal 140, an image signal including a manuscript ID corresponding to the read manuscript 142 is generated by the scanner 144. The image signal is sent to the character recognition block 146, where character recognition is performed. The threshold & positional information receiver 141 receives positional information of each recognition area in the image signal of a recognition object and the threshold for judgement of unrecognizableness, which are set in the threshold controller 244 of the central control unit 240, via the wireless network 340. Here, character recognition block 146 compares a threshold for judgement of unrecognizableness in each recognition area of the image signal received by the threshold & positional information receiver 141 and the similarity of the recognition candidate character in each recognition area. As a result of comparison, if the similarity of the recognition candidate character is larger than the threshold for judgement of unrecognizableness, the block 146 outputs a character code corresponding to the recognition candidate character as the recognition result. On the other hand, if the similarity of the recognition candidate character is less than the threshold for judgement of unrecognizableness, the block 146 outputs a predetermined rejection code as an unrecognizable character. In addition, processing executed in the character recognition block 146 will be described later in detail. The character recognition result & manuscript ID transmitter 148 transmits a character code, which is the result of character recognition by the character recognition block 146, and a rejection code, which shows unrecognizableness, and the result of manuscript ID recognition by the manuscript ID recognition block 147, to the central control unit 240 via the wireless network 340.

On the other hand, in the central control unit 240, first, the character recognition result & manuscript ID receiver 242 receives the result of character recognition and the result of manuscript ID recognition that are transmitted from the mobile terminal 140. The result of character recognition received is corrected by the character recognition result post-processor 248, is stored by the storage block 248a, and is processed like searching data, stored in the storage block 248a, with using the result of character recognition as a key. The processing-result is displayed on the display unit 241. The threshold controller 244 sets a threshold for judgement of unrecognizableness that is optimum for each recognition area in the image signal of the recognition object, on the basis of the result of manuscript ID recognition which is received, with referring to the threshold database 244a. Furthermore, the positional information every recognition area is also obtained. In addition, detail of the processing executed in the threshold controller 244 will be described later. The threshold for judgement of unrecognizableness and positional information of each recognition area in the image signal of the recognition object, which is set in the threshold controller 244, is transmitted to the mobile terminal 140 by the threshold & positional information transmitter 246 via the wireless network 340.

Next, the processing executed in the fourth embodiment will be described with reference to FIGS. 9 and 10. In addition, here, in particular, the processing executed in the character recognition block 146 and threshold controller 244 that are important parts of the fourth embodiment will be described in detail.

FIG. 9 is a flow chart showing the processing executed in the character recognition block of a fourth embodiment according to the present invention.

First, at step S340, the character recognition block 146 performs character extraction in which characters are separated from the image signal inputted from the scanner 144. At step S341, the manuscript ID recognition block 147 recognizes a manuscript ID included in the image signal inputted. Then, the manuscript ID recognition block 147 judges on the basis of the manuscript ID, which is recognized, a recognition area where the character that is extracted at the step S340 belongs among the recognition areas of the image signal. At step S342, the character recognition block 146 performs predetermined feature extraction from the character extracted at the step S340. At step S344, the block 146 calculates the similarity of the recognition object character to learned characters in the recognition dictionary 146a on the basis of the feature extracted at the step S342. At step S346, the block 146 selects the predetermined number of recognition candidate characters in the order of their amount, and sorts the recognition candidate characters. In addition, this number of recognition candidate characters is set in a number-of-recognition-candidate-characters register (not shown).

At step S348, the block 146 compares the similarity of the first candidate of the recognition candidate characters, that is, the recognition candidate character having the largest similarity, with the threshold for judgement of unrecognizableness in the recognition area, where the recognition candidate character is included, with using the unrecognizableness judging block 146b. If the similarity of the first candidate is less than the threshold for judgement of unrecognizableness in the recognition area where the recognition candidate character is included (NO at the step S348), the process goes to step S340a, where a predetermined identifier, that is, a rejection code is outputted with judging the recognition object character as an unrecognizable character. On the other hand, if the similarity of the first candidate is larger than the threshold for judgement of unrecognizableness in the recognition area where the recognition candidate character is included (YES at the step S348), the process goes to step S342a as successful recognition since it is possible to output at least one result of character recognition.

At the step S342a, two is substituted to a number-of-recognition-candidate-characters counter i (not shown) counting the number of the recognition candidate characters processed. At step S344a, it is judged whether the content of the number-of-recognition-candidate-characters counter i exceeds the number of recognition candidate characters set in the number-of-recognition-candidate-characters register. If the content of the number-of-recognition-candidate-characters counter i exceeds the number of recognition candidate characters (YES at step S344a), the subsequent processing is stopped since there is no recognition candidate character over the number. Then, the process goes to step S346a. In addition, at the step S346a, all the character codes corresponding to the recognition candidate characters having similarity exceeding the threshold for judgement of unrecognizableness are outputted. On the other hand, if the content of the number-of-recognition-candidate-characters counter i does not exceed the number of recognition candidate characters (NO at the step S344a), the process goes to step S348a.

At the step S348a, similarity of the ith candidate is compared with the threshold for judgement of unrecognizableness in the recognition area where the recognition candidate character is included. If the similarity of the ith candidate is less than the threshold for judgement of unrecognizableness in the recognition area where the recognition candidate character is included (NO at the step S348a), the ith candidate and subsequent candidates are judged as unrecognizable characters. Then, the process goes to the step S346a. On the other hand, if the similarity of the ith candidate is larger than the threshold for judgement of unrecognizableness in the recognition area where the recognition candidate character is included (YES at the step S348a), the process goes to step S349a, where the number-of-recognition-candidate-characters counter i is incremented and the process returns to the step S344a.

Owing to above processing, the rejection ratio judged in each recognition area of the image signal that is shown by the manuscript ID has the tendency shown in FIG. 17. Thus, if the rejection ratio is high, the correct solution ratio of characters judged as recognizable characters increase, but their number is few. On the contrary, if the rejection ratio is low, the number of characters judged as recognizable characters is large, but the correct solution ratio of the characters also decreases. Then, in the fourth embodiment, in order that character recognition in the mobile terminal 140 may be executed at an optimum rejection ratio, the threshold controller 144 of the central control unit 240 sets the threshold for judgement of unrecognizableness optimum for each recognition area of the image signal, which is shown by the manuscript ID, on the basis of the result of manuscript ID recognition in the manuscript ID recognition block 147 of the mobile terminal 140.

FIG. 10 is a flow chart showing the processing executed in the threshold controller of the fourth embodiment of the present invention.

At step 440, the manuscript ID of the image signal of the recognition object is judged according to the result of manuscript ID recognition received in the character recognition result & manuscript ID receiver 242. At step S442, data (a threshold for judgement of unrecognizableness and positional information of each recognition area included in the image signal of the recognition object) corresponding to the manuscript ID judged at the step S440 is obtained from the threshold database 244a.

As described above, according to the fourth embodiment, it is possible to increase recognition accuracy in each recognition area. This is because the central control unit 240 can set a threshold for judgement of unrecognizableness that is optimum for each recognition area of the image signal inputted in the mobile terminal 140, on the basis of the result of manuscript ID recognition inputted from the mobile terminal 140. In particular, in case that characters, whose writers are different, or different fonts are mixed in the same read manuscript, or a format of a read manuscript changes, the present invention can perform excellently accurate character recognition of the read manuscript, and can largely increase the efficiency of processing.

Although, in the fourth embodiment, the number of recognition candidate characters that the character recognition block 146 of the mobile terminal 140 outputs is plural, the present invention is not limited to this. For example, with selecting a recognition candidate character having the largest similarity as only one recognition candidate character, the unrecognizableness judging block 146b can perform judgement. In this case, it becomes possible to accelerate the processing.

Although, in the fourth embodiment, the communication system composed of the mobile terminal 140 and central control unit 240 that are connected via the wireless network 340 is described, the present invention is not limited to this. For example, there is no problem even if a communication system is composed of terminals and a central control unit 240 that are connected via a wired network, internet, intranet and etc..

Embodiment 5

FIG. 11 is a block diagram showing the construction of a communication system of a fifth embodiment according to the present invention.

As shown in FIG. 11, the communication system is composed of a mobile terminal 150 and a central control unit 250. In addition, the mobile terminal 150 and central control unit 250 are connected via a wireless network 350. Furthermore, here, one mobile terminal 150 and one central control unit 250 constructs the communication system, but the present invention can be also applied to a case of a communication system comprising a plurality of mobile terminals 150. Moreover, in case each mobile terminal among the plurality of mobile terminals 150 communicates with the central control unit 250, the central control unit 250 can identify each mobile terminal by starting communication, for example, after each mobile terminal issuing an identification signal different from others to the central control unit 250.

In a mobile terminal 150, symbol 152 shows a read manuscript. Symbol 154 shows a scanner reading the read manuscript 152 and generating an image signal. Symbol 156 shows a character recognition block that recognizes a recognition area of the image signal generated by the scanner 154 and performing character recognition in the recognition area, which is recognized, with using a recognition dictionary 156a. Symbol 156b shows a unrecognizableness judging block judging whether a recognition candidate character outputted by the character recognition block 156 is unrecognizable, on the basis of a threshold for judgement of unrecognizableness. Symbol 158 shows a character recognition result transmitter transmitting the result of character recognition by the character recognition block 156 and positional information showing the recognition area to the central control unit 250. Symbol 151 shows the threshold & positional information receiver receiving the positional information showing the recognition area of the image signal and a threshold for judgement of unrecognizableness in the recognition area from the central control unit 250.

In the central control unit 250, symbol 252 shows a character recognition result receiver receiving the result of character recognition and positional information from the mobile terminal 150. Symbol 258 is a character recognition result post-processor performing post-processing of the result of character recognition received by the character recognition result receiver 252. Symbol 258a shows a storage block storing data such as processing-result by the character recognition result post-processor 258. Symbol 251 shows a display unit displaying the processing-result by the character recognition result post-processor 258. Symbol 254 shows a threshold controller that judges the number of results of character recognition in each recognition area in the image signal of the recognition object, which is shown by the positional information received by the character recognition result receiver 252, and sets a threshold for judgement of unrecognizableness optimum for each recognition area in the unrecognizableness judging block 156b of the mobile terminal 150. Symbol 256 shows a threshold & positional information transmitter transmitting positional information and a threshold for judgement of unrecognizableness of each recognition area in the image signal, which is set in the threshold controller 254, to the mobile terminal 150.

In addition, in each of the mobile terminal 150 and central control unit 250, a CPU, RAM, and ROM, which are not shown, are mounted. A CPU mounted in each terminal executes various programs after developing the various programs that are stored in the ROM and is used for controlling equipment. In addition, the RAM also functions as a working area and a temporary save area.

Next, the operation of the communication system of the fifth embodiment will be described with reference to FIG. 11.

From the read manuscript 152 prepared in the mobile terminal 150, an image signal corresponding to the read manuscript 152 is generated by the scanner 154. The image signal generated is sent to the character recognition block 156, where a recognition area is recognized and character recognition in the recognition area recognized is performed. The threshold & positional information receiver 151 receives the positional information of and the threshold for judgement of unrecognizableness for each recognition area in the image signal of a recognition object, which is set in the threshold controller 254 of the central control unit 250, via the wireless network 350. Here, character recognition block 156 compares a threshold for judgement of unrecognizableness in each recognition area of the image signal received by the threshold & positional information receiver 151 and the similarity of the recognition candidate character in each recognition area. As a result of comparison, if the similarity of the recognition candidate character is larger than the threshold for judgement of unrecognizableness, the block 156 outputs a character code corresponding to the recognition candidate character as the recognition result. On the other hand, if the similarity of the recognition candidate character is less than the threshold for judgement of unrecognizableness, the block 156 outputs a predetermined rejection code as an unrecognizable character. In addition, the processing executed in the character recognition block 156 will be described in detail late