KR102343851B1 - Intelligent Civil Service Processing System - Google Patents

Abstract

The present invention includes: an identification authenticity verification unit 10 that transmits an input ID image or fingerprint image of a user recognized by the identification means 4 to the authenticity verification server to confirm the user's ID; a basic information input unit 20 for inputting basic information of a user whose authenticity is confirmed in the civil complaint form; an interactive civil complaint form input and verification unit 30 for inputting and confirming information input through voice and sign language video conversations with the user into the civil petition form and completing the civil petition form; a civil complaint form transmission and transmission unit 40 that transmits the completed civil complaint form to the administrative computer network and requests processing; It relates to an intelligent civil complaint processing system of a conversational type, characterized in that it comprises a;

Description

Interactive Intelligent Civil Service Processing System { Intelligent Civil Service Processing System }

The present invention relates to an intelligent civil complaint processing system in a conversational manner in which non-disabled people as well as deaf and visually impaired seniors can easily create and process civil complaint forms such as resident registration transfer registration, reissuance of disability registration, reissuance of youth ID, etc. in a conversational manner.

As a prior art, Korean Patent Laid-Open No. 1997-0078358 Interactive automatic civil complaint handling method

"The present invention relates to an interactive automatic civil complaint handling method in which a civil petitioner automatically issues civil documents from public offices as well as guiding tasks related to various civil complaint procedures through a public telephone network. In order to achieve the above object, the present invention The interactive automatic civil complaint handling method includes the first step in which the PC administrator and the signal processing manager initialize the entire system to start the civil service service, and the signal processing manager recognizes the civil servant's phone bell and guides the civil servant with greetings and usage. In the second step, the signal processing manager induces the civil complaint content and the calling phone number, processes the DTMF signal, and extracts the features of the complainant's voice, the PC manager recognizes the words of the complainant's voice. It is characterized in that the fourth step, and the fifth step of guiding and returning the receipt number and greeting to the complainant after recognizing the words of the complainant's voice, is carried out. It can be used as a measure to improve the existing postal civil complaint system that was provided in isolated areas as well as to eliminate unnecessary waiting time for civil servants by establishing a guide and reception system and to increase work efficiency by automating the issuance task. It works."

In addition, Laid-Open Patent No. 10-2020-0033687 discloses an unmanned system that connects a public institution server 100 that provides an administrative civil service service and a server of a work assistant organization that provides daily convenience services through an online network to share institutional information. Build a system booth; The unmanned system booth is composed of a civil complaint administration selection processing unit composed of a touch monitor on the upper side, and a living convenience selection processing unit, and a cash inlet, a card reader, a change outlet, and a donation selection switch in the front central part. an input execution kiosk configured with a settlement processing unit; On one side of the input execution kiosk, an identification card insertion reader, a number input keyboard, and a fingerprint recognition scanner are exposed and the authentication processor further has a built-in information matching program module that matches identification input information and fingerprint information to permit use authentication; form; forming a document-inserting-type scanner and a document output printer integrally mounted on the other side of the input execution kiosk; forming a frame-type reflector divided and arranged in a configuration for each set size on the rear center upper surface of the input execution kiosk, and a mirror photographing device configured to mount a digital automatic camera on the upper central inner surface of the frame-type reflector; Disclosed is an unmanned civil service processing system having a comprehensive administrative information providing function, characterized in that a roll screen structure background plate is installed on the front upper surface of the input execution kiosk opposite to the mirror imaging device.

An object of the present invention is to provide an intelligent civil complaint processing system in a conversational manner that enables non-disabled people as well as the hearing-impaired and visually impaired elderly to easily create and process civil complaint forms such as resident registration transfer registration, reissuance of disability registration, reissuance of youth ID, etc. in a conversational manner.

The interactive intelligent civil complaint processing system of the present invention transmits the user's identification image or fingerprint image recognized by the identification means (4) to the authenticity confirmation server to confirm the user's identification (ID). a confirmation unit 10; a basic information input unit 20 for inputting basic information of a user whose authenticity is confirmed in the civil complaint form; an interactive civil complaint form input and verification unit 30 for inputting and confirming information input through voice and sign language video conversations with the user into the civil petition form and completing the civil petition form; a civil complaint form transmission and transmission unit 40 that transmits the completed civil complaint form to the administrative computer network and requests processing; and a civil complaint processing result output unit 50 for outputting the processing result received through the administrative computer network.

In the interactive intelligent civil complaint processing system of the present invention, the interactive civil complaint form input unit includes a sign language interactive civil complaint form input unit 100, and the sign language interactive civil complaint form input unit 100 includes a motion recognition camera ( 4) using the user motion image generator 130, which generates a user motion image using the optical information captured by the sign language motion input unit 120, and motion information (joint and non-resin coordinates) from the user motion image A motion key point extraction unit 140 that extracts and generates a color image for artificial intelligence learning, and artificial intelligence means previously learned by receiving motion information images that are generated by the key point extraction unit 140 and are temporally continuous An AI sign language operation recognition unit 150 that recognizes a sign language operation with

A civil complaint form input unit 160, which selects words or numbers to be input in the items of the corresponding civil petition form from among the text information generated by the AI sign language operation recognition unit 130, and inputs them in the civil petition form; It is preferable to include a sign language dialog video animation unit 170, which generates an appropriate sign language image according to the input step of the civil complaint form and displays it on the display 2 .

In the interactive intelligent civil complaint processing system of the present invention, the sign language interactive civil complaint form input unit 100 generates and stores in advance sign language images requesting input by expressing each civil complaint form and items to be input in a sign language image. , and is configured to further include an input request sign language image storage unit 110 , and the sign language dialogue video animation unit 170 loads the sign language image generated from the input request sign language image storage unit 110 and displays it on the display 2 . It is desirable to animate.

In addition, in the interactive intelligent civil complaint processing system of the present invention, the interactive civil complaint form input unit includes a voice conversational input unit 200, and the voice interactive civil complaint form input unit 200 is configured to: The input request voice expression unit 210 for expressing information about the item to be input through the speaker 6 by voice, and the user voice file generation for generating a voice file about the user's voice sensed by the microphone 5 The unit 220, the voice recognition unit 230 that recognizes the voice of the user's voice file and converts it into text (words or sentences), and the corresponding civil complaint form among the text information converted and generated by the voice recognition unit 230 It is preferable to include a user voice response input unit 240 that selects words or numbers to be input in the items of , and inputs them in the civil complaint form.

According to the present invention, a sign language interactive input unit having a sign language image generation and sign language recognition function for the hearing impaired and a voice interactive input unit having a voice generation and voice recognition function for the visually impaired are provided. A dialogue-based intelligent civil complaint handling system is provided that allows not only the elderly but also non-disabled people to easily fill out and process civil complaint forms such as resident registration transfer report, disability registration, reissuance of youth ID, etc. in a conversational manner.

1 is an external configuration diagram of an intelligent civil complaint processing system in a conversational manner according to an embodiment of the present invention;
2, 3, and 4 are overall configuration diagrams of an intelligent civil complaint processing system in a conversational manner according to an embodiment of the present invention.
5 is a detailed configuration diagram of a sign language interactive civil complaint form input unit according to an embodiment of the present invention.
6 is a detailed configuration diagram of a sign language interactive civil complaint form input process according to an embodiment of the present invention.
7 is an explanatory diagram of a sign language image storage unit construction process according to an embodiment of the present invention.
8 is an explanatory diagram of artificial intelligence learning data construction process according to an embodiment of the present invention (image generation 130 common, key point extraction 140 common, recognition 150).
9 is a block diagram of an AI sign language gesture recognition unit according to an embodiment of the present invention.
10 is a detailed view of the voice conversational civil complaint form input unit 200 according to an embodiment of the present invention.
11 is a detailed view of the identification authenticity check (10) and the basic information input unit (20) of the present invention.
12 is a detailed view of the civil complaint form transmission and processing request unit 40 and the civil complaint processing result output unit 50 of the present invention.

Hereinafter, a conversational intelligent civil complaint processing system according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings. 1 is an external configuration diagram of an intelligent civil complaint handling system in a conversational manner according to an embodiment of the present invention; 5 is a detailed configuration diagram of a sign language interactive civil complaint form input unit according to an embodiment of the present invention, and FIG. 6 is a detailed configuration diagram of a sign language interactive civil complaint form input process according to an embodiment of the present invention. 11 is a detailed view of the identity verification 10 and basic information input unit 20 of the present invention, and FIG. 12 is a detailed view of the civil complaint form transmission and processing request unit 40 and civil complaint processing result output unit 50 of the present invention. .

As shown in Fig. 1, the interactive intelligent civil complaint processing system according to an embodiment of the present invention includes a kiosk body 1 forming a body, and a kiosk body 1 formed on the upper portion of the kiosk body 1 and displaying visual information to the user. An identification means (4) including a display (2), an ID recognition unit and a biometric information recognition unit configured to be exposed to the kiosk body (1), and a motion recognition camera (5) for recognizing a motion of a nearby user; It is configured to include a microphone 6 for detecting a voice signal of a nearby user, a speaker 7 for expressing voice information to the user, and a processing control unit built in the kiosk body 1 .

2 to 4, the interactive intelligent civil complaint processing system according to an embodiment of the present invention includes an identity authenticity verification unit 10, a basic information input unit 20, and an interactive civil complaint form input and verification unit. (30), a civil complaint form transmission and processing request unit 40, and a civil complaint processing result output unit (complaint result output module, 50).

2 to 4, in particular, as shown in Fig. 11, the identity verification unit 10 transmits the user's ID image or fingerprint image recognized by the identification means 3 to the authenticity verification server to the user Confirm the identity (ID) of The basic information input unit 20 inputs basic information of the user whose authenticity is confirmed in the civil complaint form.

1 and 11, in an embodiment of the present invention, the identification authenticity check unit 10 is installed in the kiosk. It connects to a public institution or an identity verification agency server through wired or wireless, asks whether the user's fingerprint or ID card is authentic, and receives the result. The identity verification unit 10 may be replaced with a term as an identity verification module. The basic information input unit 20 automatically uploads the user's basic information, name, resident number, address, etc., to the civil complaint form when the authenticity is confirmed by the identity verification unit 10 .

2 to 4 , the interactive civil complaint form input and confirmation unit 30 completes the civil complaint form by inputting and confirming information input through voice and video conversations with the user into the civil complaint form. The interactive civil complaint form input and confirmation unit 30 will be described below.

2 to 4, the civil complaint form transmission and processing request unit 40 transmits the request to the administrative computer network and requests processing. The civil complaint form transmission and processing request unit 40 transmits the completed civil complaint form to the relevant institution and requests processing.

1 and 12 , the civil complaint processing result output unit (the civil complaint processing result output module 50) outputs the processing result received through the administrative computer network. The civil complaint processing result output unit (civil complaint processing result output module, 50) generates the civil complaint processing result (approved by the relevant institution) requested by the user and transmits it to the output device, that is, the display or print module. If the complaint is rejected, a return message is generated.

In addition, the civil complaint processing result output unit (the civil complaint processing result output module, 50) may transmit the user's civil complaint application processing result to the user's mobile phone number. Here, the civil complaint processing result output unit (complaint result output module, 50) refers to a module that is generated to transmit the civil complaint processing result to the user without referring to a display means.

5 and 6 are detailed configuration diagrams of a sign language interactive civil complaint form input unit according to an embodiment of the present invention, FIG. 7 is an explanatory diagram of a sign language image storage unit construction process according to an embodiment of the present invention, and FIG. 8 is a diagram of the present invention An explanatory diagram of the AI learning data construction process according to an embodiment (image generation 130 common, key point extraction 140 common, recognition 150), FIG. 9 is a configuration diagram of an AI sign language motion recognition unit according to an embodiment of the present invention.

5 and 6 , the interactive civil complaint form input unit includes a sign language interactive civil complaint form input unit 100 . The user motion input unit 120 , the user motion image generator 130 , the motion key point extraction unit 140 , the AI sign language motion recognition unit 150 , the civil complaint form input unit 160 , and the sign language dialog video animation unit 170 . and the sign language interactive civil complaint form input unit 100 optionally includes an input request sign language conversation image storage unit 110 .

As shown in FIGS. 5 and 6 , for example, when a user (a deaf person) approaches the kiosk body, the proximity sensor 3 recognizes and the user motion input unit 120 captures the user's motion. The user performs a sign language operation to select the type of the civil complaint form, and the AI sign language operation recognition unit 150 recognizes the type of the civil complaint form, and the control unit switches the screen. In the selected civil complaint form, the user inputs a specific item in sign language, and the sign language dialogue video animation unit 170 guides the next item to be input as a sign language dialogue image. This process is repeated.

As shown in FIG. 7 , the input request sign language image storage unit 110 stores sign language images requesting input by expressing each civil complaint form and items to be input in sign language images. The sign language video animation unit 170 loads an appropriate sign language image from the input request sign language image storage unit 110 according to each civil complaint form and the input step of the selected civil complaint form, and displays it on the display 2 . Since sign language images for each item are created and stored in advance for each civil complaint form, once the type of civil complaint form is determined by the user, an accurate guide to the item is possible. This enables the sign language dialogue video animation unit 170 to respond more accurately and quickly than generating a sign language image from a wide range of sign language data by recognizing the word of the item in real time.

8 is an explanatory diagram of the AI sign language recognition learning data construction process, but the user sign language recognition process is partly common. The user motion image generating unit 130 generates a user motion image by using optical information captured by the motion recognition camera 5 . The motion key point extractor 140 extracts motion information (joint and non-resin coordinates) from the user motion image to generate a color image for artificial intelligence learning.

As shown in FIG. 9 , the AI sign language motion recognition unit 150 receives motion information images generated by the key point extraction unit 140 and temporally continuous, and recognizes the sign language motion with a pre-learned artificial intelligence means. , to generate text information (words or sentences) matching the recognized sign language action.

The civil complaint form input unit (entering the user sign language response into the civil complaint form, 160) selects words or numbers to be input in the items of the corresponding civil complaint form from among the text information generated by the AI sign language motion recognition unit 130, and inputs them in the civil complaint form. .

Again, the sign language dialogue video animation unit 170 generates a sign language image suitable for each civil complaint form and according to the input step of the selected civil complaint form, and displays it on the display 2 to request the sign language input of the next item. This process is repeated. In this way, the complaint form is completed in a sign language dialogue method.

The sign language dialogue video animation unit 170 loads an appropriate sign language image from among the previously generated and stored images according to the input step of each civil petition form and the selected civil petition form in the input request sign language image storage unit 110 and is displayed on the display 2 . can do it Alternatively, the sign language dialog video animation unit 170 may perform animation by recognizing the words of each civil petition form and the input stage of the selected civil petition form to generate a dialog image in real time.

10 is a detailed view of the voice conversational civil complaint form input unit 200 according to an embodiment of the present invention. The interactive civil complaint form input unit includes a voice interactive civil complaint form input unit 200 . As shown in FIG. 10 , the voice interactive civil complaint form input unit 200 expresses the information on the items to be input according to the input step for each civil complaint form through the speaker 6 by voice, the input request voice expression unit 210 ) and a user voice file generating unit 220 that generates a voice file related to the user's voice sensed by the microphone 5 .

In addition, the voice interactive civil complaint form input unit 200 recognizes the voice of the user's voice file and converts it into text (words or sentences) from among the text information converted and generated by the voice recognition unit 230 and the voice recognition unit 230 . It is configured to further include a user voice response input unit 240 for selecting words or numbers to be input in the items of the civil petition form and inputting the selected word or number in the civil petition form.

In the interactive intelligent civil complaint processing system according to an embodiment of the present invention, the processing control unit receives the sign language interactive civil complaint form input unit (100) when the information that the user is deaf is recognized in the bride information recognized by the identity verification unit (10). ), and when the information that the user is visually impaired is recognized, it is preferable to operate the voice conversational civil complaint form input unit 200 . In this way, it is possible to automatically provide customized services for the blind and hearing impaired immediately.

As shown, the processing control unit includes a sign language interactive civil complaint form input unit 100 that creates a civil complaint form through a sign language image generation and sign language recognition function for the hearing impaired, and a voice generation and voice recognition function for the visually impaired. and a voice conversational civil petition form input unit 200 for filling out a civil petition form.

The processing control unit includes an identification authenticity verification unit 10 that confirms the user's ID by transmitting the input ID image or fingerprint image of the user recognized by the identification recognition means 4 to the authenticity verification server, Basic information input unit 20 for inputting the confirmed user's basic information) into the civil complaint form, and inputting the information entered through voice and video conversations with the user into the civil complaint form and confirming the details to complete the civil complaint form , the interactive civil complaint form input and confirmation unit 30, the civil complaint form transmission and processing request unit 40 that transmits and requests processing of the completed civil complaint form to the administrative computer network, and outputs the civil complaint processing result received through the administrative computer network and a civil complaint processing result output unit (complaint processing result output module, 50).

Although the present invention has been described with reference to the above-mentioned preferred embodiments, the scope of the present invention is not limited to these embodiments, and the scope of the present invention is defined by the following claims and is equivalent to the present invention various modifications and variations pertaining to

The reference numerals described in the claims below are merely to aid the understanding of the invention and do not affect the interpretation of the scope of rights.

1: Kiosk body
2: Display
4: Identity Recognition Means
5: motion recognition camera
6: microphone
7: speaker
10: identity verification unit
20: basic information input unit,
30: Interactive civil complaint form input and confirmation unit (
40: Request for complaint form transmission and processing
50: Complaint processing result output unit
100: Sign language interactive civil complaint form input unit
110: input request sign language conversation video storage unit
120: user action input unit
130: user motion image generating unit
140: operation key point extraction unit
150: AI sign language motion recognition unit
160: complaint form input unit
170: sign language dialogue video animation unit
200: voice interactive civil complaint form input unit
210: input request voice expression unit
220: user voice file generation unit
230: voice recognition unit
240: user voice response input unit

Claims (10)

delete delete delete an identity verification unit 10 for transmitting an input ID image or fingerprint image of the user recognized by the identification means 4 to the authenticity verification server to confirm the user's ID;
a basic information input unit 20 for inputting basic information of a user whose authenticity is confirmed in the civil complaint form;
an interactive civil complaint form input and verification unit 30 for inputting and confirming information input through voice and sign language video conversations with the user into the civil petition form and completing the civil petition form;
a civil complaint form transmission and transmission unit 40 that transmits the completed civil complaint form to the administrative computer network and requests processing;
A civil complaint processing result output unit 50 for outputting the processing result received through the administrative computer network;

The interactive civil complaint form input unit includes a sign language interactive civil complaint form input unit 100, and the sign language interactive civil complaint form input unit 100 includes:
A user motion image generating unit 130 that generates a user motion image by using the optical information captured by the sign language motion input unit 120 using the motion recognition camera 4;
A motion key point extraction unit 140 that extracts motion information (joint and non-resin coordinates) from the user motion image to generate a color image for artificial intelligence learning;
The key point extraction unit 140 receives motion information images that are generated and temporally continuous, recognizes sign language motions using pre-learned artificial intelligence means, and generates text information (words or sentences) matching the recognized sign language motions. AI sign language motion recognition unit 150 to generate,
A civil complaint form input unit 160, which selects a word or number to be input in an item of the corresponding civil petition form from the text information generated by the AI sign language operation recognition unit 130 and inputs it in the civil petition form;
It is configured to include a sign language dialogue video animation unit 170 that generates an appropriate sign language image for each civil complaint form and the input step of the selected civil complaint form and displays it on the display 2,

The interactive civil complaint form input unit includes a voice interactive civil complaint form input unit 200, wherein the voice interactive civil complaint form input unit 200 includes:
An input request voice expression unit 210 for expressing information on items to be input according to the input step for each civil complaint form through the speaker 7 by voice;
A user voice file generating unit 220 that generates a voice file related to the user voice sensed by the microphone 5;
A voice recognition unit 230 that recognizes the voice of the user voice file and converts it into text (words or sentences);
and a user voice response input unit 240, which selects words or numbers to be input in the item of the civil petition form from among the text information converted and generated by the voice recognition unit 230 and inputs it in the civil petition form,

The sign language interactive civil complaint form input unit 100,
It is configured to further include an input request sign language image storage unit 110 for generating and storing sign language images requesting input by expressing each civil complaint form and items to be input in a sign language image,

The sign language dialogue image animation unit 170 loads the sign language image generated from the input request sign language image storage unit 110 and animates it on the display (2).
5. The method of claim 4,
The interactive civil complaint form input unit includes a sign language interactive civil complaint form input unit 100 for the hearing impaired and a voice interactive civil complaint form input unit 200 for the visually impaired,
The processing control unit operates the sign language interactive civil complaint form input unit 100 when the information that the user is deaf is recognized in the identity information recognized by the identity verification unit 10,
When the information that the user is visually impaired is recognized, the conversational intelligent civil complaint processing system, characterized in that the operation of the voice interactive civil complaint form input unit (200).
delete In the complaint handling system,
A kiosk body (1) constituting the body,
a display (2) formed on the upper portion of the kiosk body (1) and displaying visual information to a user;
an identity recognition means (4) including an ID recognition unit and a biometric information recognition unit configured to be exposed to the kiosk body (1);
A motion recognition camera 5 that recognizes a user's motion in proximity,
A microphone (6) for detecting a voice signal of a nearby user;
A speaker (7) for expressing voice information to the user;
It is configured to include a processing control unit built into the kiosk body (1),

The processing control unit,
an identity verification unit 10 for transmitting an input ID image or fingerprint image of the user recognized by the identification means 4 to the authenticity verification server to confirm the user's ID;
a basic information input unit 20 for inputting basic information of a user whose authenticity is confirmed in the civil complaint form;
an interactive civil complaint form input and verification unit 30 for inputting and confirming information entered through voice and video conversations with the user into the civil petition form and completing the civil petition form;
a civil complaint form transmission and transmission unit 40, in which the entry confirmation and transmission unit confirms the contents of the civil complaint form, transmits it to the administrative computer network, and requests processing;
and a civil complaint processing result output unit 50 for outputting the processing result received through the administrative computer network; and

The processing control unit includes a sign language interactive civil complaint form input unit 100 for creating a civil complaint form through a sign language image generation and sign language recognition function for the hearing impaired;
and a voice interactive civil complaint form input unit 200 for creating a civil complaint form through voice generation and voice recognition functions for the visually impaired,

The sign language interactive civil complaint form input unit 100,
A user motion image generating unit 130 that generates a user motion image by using the optical information captured by the sign language motion input unit 120 using the motion recognition camera 4;
A motion key point extraction unit 140 that extracts motion information (joint and non-resin coordinates) from the user motion image to generate a color image for artificial intelligence learning;
The key point extraction unit 140 receives motion information images that are generated and temporally continuous, recognizes sign language motions using pre-learned artificial intelligence means, and generates text information (words or sentences) matching the recognized sign language motions. AI sign language motion recognition unit 150 and
A civil petition form input unit 160, which selects a word or number to be input in the item of the civil petition form from the text information generated by the AI sign language operation recognition unit 130 and inputs it in the civil petition form;
It is configured to include a sign language dialogue video animation unit 170 that generates and displays an appropriate sign language image on the display 2 according to each civil complaint form and the input step of the selected civil complaint form,

The voice interactive civil complaint form input unit 200,
An input request voice expression unit 210 for expressing information about items to be input according to the input step for each civil complaint form through the speaker 7 by voice;
A user voice file generating unit 220 that generates a voice file related to the user's voice detected by the microphone 5;
A voice recognition unit 230 that recognizes the voice of the user voice file and converts it into text (words or sentences);
and a user voice response input unit 240, which selects words or numbers to be input in the item of the civil petition form from among the text information converted and generated by the voice recognition unit 230 and inputs it in the civil petition form,

The sign language interactive civil complaint form input unit 100,
It is configured to further include an input request sign language image storage unit 110, which generates and stores sign language images requesting input by expressing each civil complaint form and items to be input in sign language images,

The sign language dialogue image animation unit 170 loads the sign language image generated from the input request sign language image storage unit 110 and animates it on the display (2).
8. The method of claim 7,
A proximity sensor (3) for recognizing the approach of the kiosk user;
Interactive intelligent civil complaint handling system, characterized in that it further comprises a screen layout switching button (8) for wheelchair users.
delete delete

Images