CN202025333U - Vehicle-mounted terminal - Google Patents
Vehicle-mounted terminal Download PDFInfo
- Publication number
- CN202025333U CN202025333U CN201020664802XU CN201020664802U CN202025333U CN 202025333 U CN202025333 U CN 202025333U CN 201020664802X U CN201020664802X U CN 201020664802XU CN 201020664802 U CN201020664802 U CN 201020664802U CN 202025333 U CN202025333 U CN 202025333U
- Authority
- CN
- China
- Prior art keywords
- unit
- user
- mood
- car
- mounted terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
Images
Landscapes
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
Abstract
A vehicle-mounted terminal comprises an image acquisition unit used for acquiring current image information of a user in the vehicle, an expression identification unit which is connected with the image acquisition unit and is used for processing the image information so as to obtain expression information, an expression analysis unit which is connected with the expression identification unit and is used for identifying motion of the user based on the expression information, and a service unit which is connected with the expression analysis unit and is used for providing service corresponding to the motion of the user. The vehicle-mounted terminal can provide service in accordance with the motion of the vehicle user, thereby providing customized driving experience for the user.
Description
Technical field
The utility model relates to automotive field, particularly a kind of car-mounted terminal.
Background technology
Along with the development of automobile industry, the quantity of automobile is more and more.People are when having automobile, also more and more pay close attention to the experience when using automobile, car-mounted terminal on the automobile can realize comprising the service of multimedia demands such as music, video, picture, and the service of traffic navigation aspect such as real-time road signal, destination maps etc.
Instantly, the human face expression automatic identification technology develops very fast under the promotion of various application, and main application comprises man-machine interaction, safety, robot manufacturing, medical treatment, communication and automotive field etc. at present.Especially in automotive field, aspect the security that FacialExpression Recognition is applied to drive in driving more, for example: by identification (whether eyes are in closure state, whether yawning behavior etc. is arranged) to driver face, judge whether this driver is in the state of fatigue driving, if the driver is current is fatigue driving, then send prompting, thereby guarantee traffic safety.But the correlation technique application reference number is 200710098412.3 disclosed a kind of vehicle security drive monitoring system of Chinese invention patent application and method.
But, car-mounted terminal of the prior art can not provide based on user's mood adapt with it service, give the driving of user individual (riding) and experience.
The utility model content
The technical problems to be solved in the utility model is the service that car-mounted terminal of the prior art can not provide the personalization that adapts with it based on user's mood.
For addressing the above problem, the utility model provides a kind of car-mounted terminal, comprise: the image collection unit that is suitable for gathering the current image information of the interior user of car, be suitable for connecting described image collection unit, described image information is handled to obtain the Expression Recognition unit of expression information, be suitable for connecting described Expression Recognition unit, based on the mood analytic unit of described expression information with the identification user mood, be suitable for the service unit that connects described mood analytic unit, the service that adapts with described user mood is provided.
Optionally, described image collection unit is a camera head.
Optionally, described image collection unit is arranged at and corresponding zone, vehicle driver position.
Optionally, described Expression Recognition unit comprises: be suitable for extracting the feature extraction unit of the face characteristic in the described image information, be suitable for described face characteristic and default face characteristic are compared to obtain the feature comparing unit of expression information.
Optionally, described face characteristic is one or more combinations in geometric properties, statistical nature, frequency field feature, the motion feature.
Optionally, also comprise connecting described service unit and mood analytic unit, be suitable for control module based on the described user mood that identifies, the described service unit of control.
Optionally, described service unit is a music player.
Optionally, described service unit sends the speed of a motor vehicle monitoring device of prompting when exceeding with the corresponding default vehicle speed range of described user mood in the current vehicle speed that monitors.
Optionally, described service unit is an emergency call apparatus.
Compared with prior art, the utlity model has following advantage:
By the expression of user in the car is gathered and is discerned, based on the current mood of expression analysis user that identifies, and provide the service that adapts with user mood, drive (the riding) that give user individual experienced.
Description of drawings
Fig. 1 is a kind of example structure synoptic diagram of the car-mounted terminal that provides of the utility model;
Fig. 2 is the structural representation of Expression Recognition shown in Figure 1 unit;
Fig. 3 is the another kind of example structure synoptic diagram of the car-mounted terminal that provides of the utility model.
Embodiment
For above-mentioned purpose of the present utility model, feature and advantage can more be become apparent, embodiment of the present utility model is described in detail below in conjunction with accompanying drawing.Set forth detail in the following description so that fully understand the utility model.But the utility model can be different from alternate manner described here and implements with multiple, and those skilled in the art can do similar popularization under the situation of the utility model intension.Therefore the utility model is not subjected to the restriction of following public embodiment.
Because car-mounted terminal of the prior art can not provide the service that adapts with it based on user's mood, drive (the riding) that give user individual experienced.For this reason, the utility model provides a kind of car-mounted terminal, with specific embodiment described car-mounted terminal is elaborated below.
Consulting Fig. 1, is a kind of example structure synoptic diagram of the car-mounted terminal that provides of the utility model.Described car-mounted terminal comprises: the image collection unit 101 that is suitable for gathering the current image information of the interior user of car, be suitable for connecting described image collection unit 101, described image information is handled to obtain the Expression Recognition unit 102 of expression information, be suitable for connecting described Expression Recognition unit 102, based on the mood analytic unit 103 of described expression information with the identification user mood, be suitable for the service unit 104 that connects described mood analytic unit 103, the service that adapts with described user mood is provided.
In specific embodiment, described image collection unit 101 is a camera head, for example Digital Video or digital camera.In the present embodiment, described image collection unit 101 is arranged at and corresponding zone, vehicle driver position, for example be arranged on the instrument desk of vehicle and towards driver's face, the image of face information that is used for the collection vehicle driver, described image information comprise the still image or the dynamic image sequence of user face.At other embodiment, described image collection unit 101 also can be arranged at the corresponding zone of other passenger position, is used to gather passenger's image of face information.
Behind the current image information of user, send described Expression Recognition unit 102 in the car that described image collection unit 101 collects, handle to obtain expression information by the 102 pairs of described image informations in described Expression Recognition unit.Fig. 2 is the structural representation of Expression Recognition shown in Figure 1 unit.As shown in Figure 2, described Expression Recognition unit 102 comprises: be suitable for extracting the feature extraction unit 102a of the face characteristic in the described image information, be suitable for described face characteristic and default face characteristic are compared to obtain the feature comparing unit 102b of expression information.The 102 pairs of described image informations in described Expression Recognition unit are handled with the process of obtaining expression information specifically can be divided into two big steps, for comparing to obtain expression information, finish by described feature extraction unit 102a and feature comparing unit 102b respectively to the feature of described image information extraction people face with described face characteristic and default face characteristic.
The face characteristic that described feature extraction unit 102a extracts in the described image information also comprises the image pre-service, promptly to the normalization of the size and the gray scale of image, and the rectification of head pose, image segmentation etc.Can improve picture quality by the pre-service to image, eliminate noise, unified gradation of image value and size are for postorder feature extraction and Classification and Identification are laid a solid foundation.Cutting apart and the normalized (yardstick normalizing and gray scale normalizing) of facial expression image of its groundwork behaviour face Expression Recognition subregion.
After image is carried out pre-service, carry out feature extraction, be about to dot matrix and change into the higher level Image Representation, as shape, motion, color, texture, space structure etc., guaranteeing under the prerequisite of stability and discrimination huge view data to be carried out dimension-reduction treatment as far as possible.The main method of feature extraction has: extract geometric properties, statistical nature, frequency field feature and motion feature etc., in the present embodiment, can take one or more combinations in the above-mentioned feature extracting method.For example, extracting geometric properties is a kind of mode comparatively commonly used, adopting geometric properties to carry out feature extraction mainly is notable feature to human face expression, change in location as eyes, eyebrow, face etc. positions, measures, determine features such as its size, distance, shape and mutual ratio, carry out Expression Recognition.Lose some identifications and classified information though adopt geometric properties to carry out feature extraction, caused result's accuracy to descend to some extent,, this mode has reduced the input data volume, can improve the efficient of feature extraction greatly.
After described feature extraction unit 102a has extracted face characteristic in the described image information, described face characteristic and default face characteristic are compared to obtain expression information by described feature comparing unit 102b.Particularly, described feature comparing unit 102b includes the expression database of setting up in advance, store in this database all users of this car the face characteristic data and with the corresponding expression information of described face characteristic data, after comparing by the face characteristic of preestablishing in the face characteristic data that will extract and this database, just can obtain the current expression information of user.Described expression information specifically is meant the kind based on the pairing expression of extracting of face characteristic data, for example Gao Xing expression, angry expression etc.
After described feature comparing unit 102b compares described face characteristic and default face characteristic and obtains expression information, send described expression information to described mood analytic unit 103, by described mood analytic unit 103 based on described expression information with identification user mood.According to the study, the mankind have six kinds of main emotions, and every kind of emotion reflects the psychological activity of a kind of uniqueness of people with unique expression.These six kinds of emotions are called as basic emotion, are made up of indignation (anger), glad (happiness), sad (sadness), surprised (surprise), detest (disgust) and fear (fear).Therefore, described mood analytic unit 103 can be according to different expression informations to identify active user's mood.Certainly, countenance is not unique emotion manifestation mode, infers people's hidden feeling if desired more accurately, can also the integrated voice intonation, multi-aspect information such as pulse, body temperature judges.For example monitoring devices such as pulse, body temperature can be set, the data of user's pulse, body temperature be sent to the mood analytic unit carry out analyzing and processing, judge thereby comprehensively draw more accurately.
Need to prove, when reality is implemented, can user's expression be classified as three major types simply according to the recognition capability of described Expression Recognition unit 102, i.e. good mood, difference mood and the general pairing expression of mood.Like this, owing to do not need user's various expressions are made accurate identification, have better practicality, along with further developing of Expression Recognition technology, can discern at the multiple different expression of user, thereby provide more careful, personalized service for the user.
Described mood analytic unit 103 is after identifying active user's mood, can be based on the result of the different user mood of discerning, by producing the mode of relative trigger control signal, control described service unit 104 service that adapts with user mood is provided for the user.In the specific embodiment, described service unit 104 can be music player, as car audio system.After described mood analytic unit 103 identifies user mood based on described expression information, select to broadcast the music that adapts at the current mood of user by described service unit 104.For example, when user mood is relatively poor, can recommends to play or play automatically some to the user and make the people feel to be in a cheerful frame of mind or the song of heartsease.
Certainly, described service unit 104 also can send the speed of a motor vehicle monitoring device of prompting when exceeding with the corresponding default vehicle speed range of described user mood in the current vehicle speed that monitors.Particularly, can be with the default different vehicle speed range of different user moods, for example the speed of a motor vehicle can not be above a kilometer/hour during mood relatively poor (indignation, sadness etc.), when the current vehicle speed that records when described speed of a motor vehicle monitoring device surpasses a kilometer/hour, then send prompting automatically, even can force to limit the speed of a motor vehicle so that the user drives under the emotion influence not being subjected to, guarantee traffic safety.
In addition, described service unit 104 can also be emergency call apparatus.When the user runs into emergency condition, (very short a period of time before for example getting into an accident, for example several seconds), user's expression is owing to have a very big difference (being generally terrified expression) with usual, and the possible also impotentia oneself of user is sent urgent call to rescue center/call center after the traffic accident, at this moment, described Expression Recognition unit 102 sends the user's expression information that obtains to described mood analytic unit 103, described mood analytic unit 103 based on the traffic accident that identifies before user mood trigger described emergency call apparatus and send emergency call information (positional information that comprises current vehicle) to rescue center/call center, can guarantee that like this user is rescued timely.
In other embodiments, described car-mounted terminal also can comprise described service unit of connection and mood analytic unit, is suitable for the control module based on the described user mood that identifies, the described service unit of control.Figure Fig. 3 is the another kind of example structure synoptic diagram of the car-mounted terminal that provides of the utility model, as shown in Figure 3, described car-mounted terminal comprises: image collection unit 101, Expression Recognition unit 102, mood analytic unit 103 ', service unit 104 ' and control module 105, described control module 105 connects described service unit 104 ' and mood analytic unit 103 ', is suitable for the described user mood, the described service unit 104 ' of control that identify based on described mood analytic unit 103 '.Among the last embodiment, described service unit can be one or more combinations of all kinds of devices such as music player, speed of a motor vehicle monitoring device, when reality is implemented, because the onboard system that various car-mounted devices are formed is comparatively complicated, can't finish control by described mood analytic unit to the various car-mounted devices of forming described service unit, therefore, the described control module 105 of present embodiment need be set to realize control to the service unit 104 ' of a plurality of car-mounted devices compositions.Concrete enforcement can not repeat them here with reference to a last embodiment.
To sum up, the car-mounted terminal that the utility model provides has following beneficial effect at least:
By user's expression is gathered and is discerned, based on the current mood of expression analysis user that identifies, and provide the service that adapts with user mood, drive (the riding) that give user individual experienced.
Though the utility model with preferred embodiment openly as above; but it is not to be used for limiting the utility model; any those skilled in the art are not in breaking away from spirit and scope of the present utility model; can utilize the method and the technology contents of above-mentioned announcement that technical solutions of the utility model are made possible change and modification; therefore; every content that does not break away from technical solutions of the utility model; to any simple modification, equivalent variations and modification that above embodiment did, all belong to the protection domain of technical solutions of the utility model according to technical spirit of the present utility model.
Claims (7)
1. a car-mounted terminal is characterized in that, comprising: the image collection unit that is suitable for gathering the current image information of the interior user of car; Be suitable for described image information is handled to obtain the Expression Recognition unit of expression information, described Expression Recognition unit is connected with described image collection unit; Be suitable for based on the mood analytic unit of described expression information with the identification user mood, described mood analytic unit is connected with described Expression Recognition unit; Be suitable for providing the service unit of the service that adapts with described user mood, described service unit is connected with described mood analytic unit.
2. car-mounted terminal according to claim 1 is characterized in that, described image collection unit is a camera head.
3. car-mounted terminal according to claim 1 is characterized in that, described image collection unit is arranged at and corresponding zone, vehicle driver position.
4. car-mounted terminal according to claim 1 is characterized in that, also comprises connecting described service unit and mood analytic unit, is suitable for the control module based on the described user mood that identifies, the described service unit of control.
5. car-mounted terminal according to claim 1 is characterized in that, described service unit is a music player.
6. car-mounted terminal according to claim 1 is characterized in that, described service unit sends the speed of a motor vehicle monitoring device of prompting when exceeding with the corresponding default vehicle speed range of described user mood in the current vehicle speed that monitors.
7. car-mounted terminal according to claim 1 is characterized in that, described service unit is an emergency call apparatus.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201020664802XU CN202025333U (en) | 2010-12-16 | 2010-12-16 | Vehicle-mounted terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201020664802XU CN202025333U (en) | 2010-12-16 | 2010-12-16 | Vehicle-mounted terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN202025333U true CN202025333U (en) | 2011-11-02 |
Family
ID=44850277
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201020664802XU Expired - Lifetime CN202025333U (en) | 2010-12-16 | 2010-12-16 | Vehicle-mounted terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN202025333U (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102541259A (en) * | 2011-12-26 | 2012-07-04 | 鸿富锦精密工业（深圳）有限公司 | Electronic equipment and method for same to provide mood service according to facial expression |
| CN103183029A (en) * | 2011-12-30 | 2013-07-03 | 财团法人车辆研究测试中心 | Vehicle driving state monitoring system and method |
| CN103318079A (en) * | 2013-04-09 | 2013-09-25 | 浙江吉利汽车研究院有限公司杭州分公司 | intelligentIntelligent sound box entertainment system |
| CN103873512A (en) * | 2012-12-13 | 2014-06-18 | 深圳市赛格导航科技股份有限公司 | Method for vehicle-mounted wireless music transmission based on face recognition technology |
| CN104376855A (en) * | 2014-10-16 | 2015-02-25 | 上海天奕达电子科技有限公司 | Intelligent information processing method and system and intelligent handset |
| CN104777910A (en) * | 2015-04-23 | 2015-07-15 | 福州大学 | Method and system for applying expression recognition to display device |
| CN107918637A (en) * | 2016-10-11 | 2018-04-17 | 本田技研工业株式会社 | service providing apparatus and service providing method |
| CN108040284A (en) * | 2017-12-21 | 2018-05-15 | 广东欧珀移动通信有限公司 | Radio station control method for playing back, device, terminal device and storage medium |
| CN108090446A (en) * | 2017-12-18 | 2018-05-29 | 大陆汽车投资（上海）有限公司 | Vehicular intelligent response method based on recognition of face |
| CN109308916A (en) * | 2018-08-14 | 2019-02-05 | 上海常仁信息科技有限公司 | A kind of music playing system cooperating robot emotion communication |
| CN110297676A (en) * | 2018-03-21 | 2019-10-01 | 上海博泰悦臻电子设备制造有限公司 | A kind of switching vehicle device subject methods and vehicle system |
-
2010
- 2010-12-16 CN CN201020664802XU patent/CN202025333U/en not_active Expired - Lifetime
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8847884B2 (en) | 2011-12-26 | 2014-09-30 | Hong Fu Jin Precision Industry (Shenzhen) Co., Ltd. | Electronic device and method for offering services according to user facial expressions |
| TWI475410B (en) * | 2011-12-26 | 2015-03-01 | Hon Hai Prec Ind Co Ltd | Electronic device and method thereof for offering mood services according to user expressions |
| CN102541259A (en) * | 2011-12-26 | 2012-07-04 | 鸿富锦精密工业（深圳）有限公司 | Electronic equipment and method for same to provide mood service according to facial expression |
| CN103183029A (en) * | 2011-12-30 | 2013-07-03 | 财团法人车辆研究测试中心 | Vehicle driving state monitoring system and method |
| CN103873512A (en) * | 2012-12-13 | 2014-06-18 | 深圳市赛格导航科技股份有限公司 | Method for vehicle-mounted wireless music transmission based on face recognition technology |
| CN103318079A (en) * | 2013-04-09 | 2013-09-25 | 浙江吉利汽车研究院有限公司杭州分公司 | intelligentIntelligent sound box entertainment system |
| CN104376855A (en) * | 2014-10-16 | 2015-02-25 | 上海天奕达电子科技有限公司 | Intelligent information processing method and system and intelligent handset |
| CN104777910A (en) * | 2015-04-23 | 2015-07-15 | 福州大学 | Method and system for applying expression recognition to display device |
| CN107918637A (en) * | 2016-10-11 | 2018-04-17 | 本田技研工业株式会社 | service providing apparatus and service providing method |
| CN107918637B (en) * | 2016-10-11 | 2022-02-25 | 本田技研工业株式会社 | Service providing apparatus and service providing method |
| CN108090446A (en) * | 2017-12-18 | 2018-05-29 | 大陆汽车投资（上海）有限公司 | Vehicular intelligent response method based on recognition of face |
| CN108040284A (en) * | 2017-12-21 | 2018-05-15 | 广东欧珀移动通信有限公司 | Radio station control method for playing back, device, terminal device and storage medium |
| CN110297676A (en) * | 2018-03-21 | 2019-10-01 | 上海博泰悦臻电子设备制造有限公司 | A kind of switching vehicle device subject methods and vehicle system |
| CN109308916A (en) * | 2018-08-14 | 2019-02-05 | 上海常仁信息科技有限公司 | A kind of music playing system cooperating robot emotion communication |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN202025333U (en) | Vehicle-mounted terminal | |
| US20210362725A1 (en) | Pacification method, apparatus, and system based on emotion recognition, computer device and computer readable storage medium | |
| CN106649843A (en) | Media file recommending method and system based on vehicle-mounted terminal and vehicle-mounted terminal | |
| CN112215097A (en) | Method for monitoring driving state of vehicle, vehicle and computer readable storage medium | |
| CN113723528A (en) | Vehicle-mounted voice-video fusion multi-mode interaction method, system, device and storage medium | |
| CN111223479A (en) | Operation authority control method and related equipment | |
| CN110944149A (en) | Child care system and method for vehicle | |
| CN112744174A (en) | Vehicle collision monitoring method, device, equipment and computer readable storage medium | |
| CN212579832U (en) | Man-machine interaction system for vehicle driving safety and vehicle | |
| KR102270011B1 (en) | Deep learning-based autonomous vehicle visualize system for the visually impaired and method thereof | |
| CN109835280B (en) | System for displaying vehicle state and driving behavior through voice recognition and vehicle | |
| CN108710821A (en) | Vehicle user state recognition system and its recognition methods | |
| CN110826433B (en) | Emotion analysis data processing method, device and equipment for test driving user and storage medium | |
| CN113168644A (en) | Method and apparatus for monitoring vehicle occupants | |
| CN115391590A (en) | Car music push method and system based on face recognition | |
| CN115620407A (en) | Information exchange method and device and vehicle | |
| CN114821552A (en) | Desktop background dynamic display method, device, equipment and storage medium | |
| CN112261586A (en) | Method for automatically identifying driver to limit driving range of driver by using vehicle-mounted robot | |
| CN112738364A (en) | User monitoring device and method based on facial expression and voice recognition | |
| CN114360241B (en) | Vehicle interaction method, vehicle interaction device and storage medium | |
| CN114523979A (en) | Fatigue driving detection method and system | |
| CN116127366B (en) | Emotion recognition method, system and medium based on TWS earphone | |
| US12252133B2 (en) | Vehicle agent device, vehicle agent system, and computer-readable storage medium | |
| JP2020103702A (en) | Information processing device and program | |
| CN118618231B (en) | Automobile cockpit monitoring method, device, related equipment and computer program product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CX01 | Expiry of patent term | ||
| CX01 | Expiry of patent term |
Granted publication date: 20111102 |