CN113771703B - Automobile co-driver seat adjusting method and system - Google Patents
Automobile co-driver seat adjusting method and system Download PDFInfo
- Publication number
- CN113771703B CN113771703B CN202110874258.4A CN202110874258A CN113771703B CN 113771703 B CN113771703 B CN 113771703B CN 202110874258 A CN202110874258 A CN 202110874258A CN 113771703 B CN113771703 B CN 113771703B
- Authority
- CN
- China
- Prior art keywords
- seat
- passenger
- image
- information
- main control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 54
- 238000012545 processing Methods 0.000 claims description 50
- 230000004438 eyesight Effects 0.000 claims description 34
- 230000009471 action Effects 0.000 claims description 15
- 230000008569 process Effects 0.000 claims description 15
- 239000000284 extract Substances 0.000 claims description 9
- 230000016776 visual perception Effects 0.000 abstract description 3
- 238000011161 development Methods 0.000 description 5
- 230000018109 developmental process Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000001914 filtration Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 230000009191 jumping Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000011218 segmentation Effects 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 239000005357 flat glass Substances 0.000 description 1
- 238000003709 image segmentation Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60N—SEATS SPECIALLY ADAPTED FOR VEHICLES; VEHICLE PASSENGER ACCOMMODATION NOT OTHERWISE PROVIDED FOR
- B60N2/00—Seats specially adapted for vehicles; Arrangement or mounting of seats in vehicles
- B60N2/02—Seats specially adapted for vehicles; Arrangement or mounting of seats in vehicles the seat or part thereof being movable, e.g. adjustable
- B60N2/0224—Non-manual adjustments, e.g. with electrical operation
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Aviation & Aerospace Engineering (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
Abstract
The invention provides an automobile co-driver adjusting method and system, which can acquire information of passengers on a co-driver seat through visual perception, judge whether seat adjustment is required, and enable the passengers holding large articles to adjust the seat under the condition of no free hands by means of a voice system mobile phone passenger instruction.
Description
Technical Field
The invention relates to the technical field of artificial intelligence, in particular to a method and a system for adjusting an automobile front passenger seat.
Background
With the great popularity of automobiles, ride comfort has become an aspect of people's choice for vehicles. After the rapid development of the vehicle-mounted entertainment information system, people hope to fully utilize the space in the vehicle, and a better requirement is provided for adjusting the space in the vehicle. The electronic development of seats in cabins can help the car owners to manually adjust the positions of the seats to a great extent, and the problem of adjusting the space in the car is solved to a certain extent. However, sometimes the car owner does not have the condition to manually adjust the seat, or more hopefully the car is reminded intelligently, the adjustment function can be completed through a simple dialogue, and therefore hands are liberated. The development of artificial intelligence enables the technology to be realized, and adjustment of the driver seat can be completed through image recognition and voice interaction.
Disclosure of Invention
This section is intended to outline some aspects of embodiments of the invention and to briefly introduce some preferred embodiments. Some simplifications or omissions may be made in this section as well as in the description summary and in the title of the application, to avoid obscuring the purpose of this section, the description summary and the title of the invention, which should not be used to limit the scope of the invention.
Therefore, the technical problem to be solved by the invention is to overcome the defect that the automobile front passenger seat in the prior art cannot be automatically adjusted under the condition that passengers are inconvenient, so as to provide an automobile front passenger seat adjusting method and an automobile front passenger seat adjusting system based on visual and sound perception automatic adjustment.
In order to solve the technical problems, the invention provides the following technical scheme: an automobile copilot seat adjusting method is characterized in that: comprising
The method comprises the steps that passenger seat information is collected, a vision system collects image information of a passenger seat in a vehicle, the image information is processed into seat space parameters, and the seat space parameters are sent to a main control system;
inquiring the passengers, judging whether to adjust the seats or not by the main control system according to the received seat space parameters, sending inquiry sentences to the passengers through the sound system, collecting voice instructions of the passengers, and determining whether to send adjustment action instructions to the seat system or not;
and the seat is adjusted, and the seat system executes the seat adjusting action according to the action adjusting instruction sent by the main control system until a user sends a stopping instruction or the vision system detects that the adjustment limit is reached, so that the adjustment action is stopped.
As a preferred embodiment of the method for adjusting a passenger seat of a vehicle according to the present invention, there is provided: the image information of the passenger seat in the vehicle is collected by an image collecting module in the vision system.
As a preferred embodiment of the method for adjusting a passenger seat of a vehicle according to the present invention, there is provided: the in-car image acquisition module acquires the image information on the co-driver seat, the image processing module processes the image information of the in-car image processing machine, and then the image processing module extracts the characteristic information by the image recognition module and sends the characteristic information to the main control system.
As a preferred embodiment of the method for adjusting a passenger seat of a vehicle according to the present invention, there is provided: and the main control system judges whether a large article is placed on the front passenger seat according to the characteristic information sent by the vision system, and if so, the seat system is ready to be started to adjust the seat.
As a preferred embodiment of the method for adjusting a passenger seat of a vehicle according to the present invention, there is provided: the image recognition module extracts the outline of the copilot seat in the image, and the main control system recognizes whether a large article is placed on the copilot seat according to the outline.
As a preferred embodiment of the method for adjusting a passenger seat of a vehicle according to the present invention, there is provided: before adjusting the seat, the main control system sends voice inquiry information to the sound system, a sound playing module in the sound system plays the inquiry information to inquire whether a passenger needs to adjust the seat, and a sound collecting module in the sound system starts collecting the voice information of the passenger.
As a preferred embodiment of the method for adjusting a passenger seat of a vehicle according to the present invention, there is provided: after the voice acquisition module acquires the voice command of the passenger, the voice processing module adjusts the voice command into machine language and transmits the machine language to the voice recognition module, and the voice recognition module extracts keywords and sends the keywords as request information to the main control system.
As a preferred embodiment of the method for adjusting a passenger seat of a vehicle according to the present invention, there is provided: the main control system judges whether a passenger needs to adjust the seat according to the received request information; if so, the seat is adjusted rearward to increase the passenger space.
As a preferred embodiment of the method for adjusting a passenger seat of a vehicle according to the present invention, there is provided: in the seat adjusting process, the vision system collects image information of the position of the copilot seat, sends the processed image information to the main control system, judges whether the seat reaches the limit position, and if so, stops seat adjustment; the sound system collects voice information of a user and sends the voice information to the main control system to send out information for stopping adjustment when the passenger judges that the passenger gives out a stopping instruction, and the passenger stops adjusting the seat if the passenger gives out the stopping instruction.
The invention also provides an adjusting system of the automobile co-driver seat, which comprises
The visual system comprises an image acquisition module arranged in the vehicle, an image processing module and an image recognition module, wherein the image processing module and the image recognition module are used for processing, recognizing and acquiring image information;
the sound system comprises a sound acquisition module arranged in the vehicle, a sound processing module and a sound recognition module, wherein the sound processing module is used for processing and recognizing voice information;
the main control system is connected with the vision system and the sound system, and is used for receiving and processing information sent by the vision system and the sound system and sending a seat adjustment instruction to the seat system;
the seat system is arranged on the seat, connected with the main control system and used for receiving and executing the seat adjusting instruction sent by the main control system.
The invention has the beneficial effects that: according to the method and the system for adjusting the automobile co-driver seat, the information of the passengers on the co-driver seat can be obtained through visual perception, whether the seats are to be adjusted or not is judged, and the passengers holding large articles can adjust the seats under the condition of no free hands by means of the voice system mobile phone passenger instruction.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art. Wherein:
fig. 1 is a structural view of a passenger seat adjustment system for a vehicle in embodiment 2;
FIG. 2 is a block diagram of a master control system in embodiment 2;
fig. 3 is a diagram of a seat control circuit in embodiment 2;
FIG. 4 is a flow chart of example 3;
description of the reference numerals
100. A master control system; 200. a vision system; 300. a sound system; 400. seating system
101. A central processing unit; 102. a reservoir;
201. an image acquisition module; 202. an image processing module; 203. an image recognition module;
301. a sound collection module; 302. a sound processing module; 303. and a voice recognition module.
Detailed Description
In order that the above-recited objects, features and advantages of the present invention will become more readily apparent, a more particular description of the invention will be rendered by reference to specific embodiments thereof which are illustrated in the appended drawings.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, but the present invention may be practiced in other ways other than those described herein, and persons skilled in the art will readily appreciate that the present invention is not limited to the specific embodiments disclosed below.
Further, reference herein to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic can be included in at least one implementation of the invention. The appearances of the phrase "in one embodiment" in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments.
Example 1
The embodiment provides a method for adjusting a passenger seat of an automobile, which comprises the steps of collecting passenger seat information, inquiring passengers and adjusting the seat.
When the information of the front passenger seat is acquired, the vision system 200 acquires the image information of the front passenger seat in the vehicle, processes the image information into seat space parameters, and sends the seat space parameters to the master control system 100; the main control system 100 judges whether to adjust the seat according to the received seat space parameters, sends out inquiry sentences to passengers through the sound system 300, collects voice instructions of the passengers, and determines whether to send out adjustment action instructions to the seat system 400; then the seat system 400 executes the seat adjustment action according to the action adjustment instruction sent by the main control system 100 until the user sends a stop instruction or the vision system 200 detects that the adjustment limit is reached, and stops the adjustment action; the information of the passenger on the co-driver seat is obtained through visual perception, whether seat adjustment is to be carried out or not is judged, and the passenger instruction is sent to the mobile phone through the sound system 300, so that the passenger holding the large article can realize the adjustment of the seat under the condition of no free hands.
The image information of the passenger seat in the vehicle is collected by the image collecting module 201 in the vision system 200, the image collecting module 201 in the vehicle collects the image information of the passenger seat, the image processing module 202 processes the image information of the machine in the vehicle, and then the image identifying module 203 extracts the characteristic information and sends the characteristic information to the main control system 100.
The image information above or beside the front passenger seat collected in the vision system 200 in the embodiment is processed into a contour image by the image processing module 202 and the image recognition module 203, and is sent to the main control system 100; the main control system 100 sends out characteristic information according to the vision system 200, compares the characteristic information with a preset image of a large article, and judges whether the large article is placed on the front passenger seat or not by utilizing an image algorithm; if a large article is placed, calculating the space size on the current co-pilot seat, comparing with a preset space threshold value, and if the space is smaller than the threshold value, preparing to start the seat system 400 to adjust the seat; if greater than the threshold, no adjustment is required.
Specifically, the image recognition process in this embodiment is as follows:
image loading, loading image information acquired by the image acquisition module 201 of the vision system 200 into an image processing environment, such as an OPENCV vision library.
Correcting an image, detecting whether the image is abnormal or not, and selecting a reference original image; the reference artwork in this embodiment may be multiple, and the reference artwork is based on the images acquired by the corresponding image acquisition module 201 from different angles on the front passenger seat without the large items.
Image processing, comprising:
1. graying the image, changing the color in the image into gray by adopting a weighted average method, and changing the gray of different areas;
2. image filtering, namely suppressing noise in an image by using a median filtering method so as to improve the accuracy of a subsequent processing result;
3. binarizing an image, namely, marking a segmentation threshold value of a foreground (namely, a target) and a background as T for the image I (x, y) by using an OTSU algorithm, marking the proportion of the number of pixels belonging to the foreground to the whole image as omega 0, and marking the average gray level as mu 0; the number of background pixels accounts for the proportion omega 1 of the whole image, and the average gray scale is mu 1; the average gray level of the whole image is denoted μ, and the inter-class variance is denoted g.
Assuming that the image size is m×n, the number of pixels in the image with gray values smaller than the threshold T is N0 and the number of pixels with gray values larger than the threshold T is N1, then
ω0＝N0/M×N
ω1＝N1/M×N
N0+N1＝M×N
ω0+ω1＝1
μ＝ω0*μ0+ω1*μ1
g＝ω0(μ0-μ)^2+ω1(μ1-μ)^2
g＝ω0ω1(μ0-μ1)^2
A traversing method is adopted to make the inter-class variance g the maximum threshold T; and changing the part with the gray level smaller than T in the image into a background, and taking the part with the gray level larger than T as a foreground to obtain a binarized image.
4. Image segmentation, namely sequentially using an image opening operation, an image closing operation and a binary inversion method to mainly identify three areas of a left side frame, a front windshield and a roof of a copilot so as to find an interested area; since the brightness of these three areas is higher during the daytime or lower during the night, the images are easily distinguished from the articles or passengers on the passenger seat after processing, and thus are more easily recognized.
And (3) result processing: after the main control system 100 obtains the image processing result, it selects the pearson correlation coefficient, the pixels and the ratio between the images to judge whether the three areas have larger difference with the original reference image because of the object shielding; if so, judging that the copilot has large articles to occupy space, if so, comparing the size of the copilot vacant space with a preset space threshold, and if so, obtaining a result of needing to adjust the seat by the main control system 100, wherein the result is that whether a passenger needs to adjust or not is also required before the result; and if the confirmation answer of the passenger is obtained, executing the adjustment command.
In the adjustment process, the vision system 200 always keeps the state of the collected image to determine that the preset maximum spatial position is reached, and the process is the same as the above image recognition process, and will not be described herein.
Before adjusting the seat, the main control system 100 sends a voice query to the sound system 300, and the sound playing module in the sound system 300 plays the query to inquire whether the passenger needs to adjust the seat, and the sound collecting module 301 in the sound system 300 starts collecting the voice information of the passenger.
After the voice acquisition module 301 acquires the voice command of the passenger, the voice processing module 302 adjusts the voice command to machine language and transmits the machine language to the voice recognition module 303, the voice recognition module 303 extracts keywords, and the keywords are sent to the main control system 100 as request information.
Specifically, the voice recognition process is as follows:
pretreatment, comprising:
1. the mute cutting of the head and the tail reduces the interference to the subsequent steps;
2. the sound is divided into frames, the sound is cut into a plurality of small segments by using a moving window function, each small segment is called a frame, and overlapping exists between the frames.
Feature extraction: converting each frame waveform into a multidimensional vector containing sound information by using a Linear Prediction Cepstral Coefficient (LPCC) and Mel cepstral coefficient (MFCC) algorithm;
speech decoding and algorithm searching, comprising:
1. acoustic Model (AM): the method comprises the steps of training voice data to obtain the voice data, wherein the input is a feature vector, and the output is phoneme information;
2. loading a dictionary: establishing the correspondence between the words or the words and the phonemes;
3. language Model (LM): training a large amount of text information to obtain the probability of mutual association of single characters or words;
decoding: performing text output on the audio data with the extracted features through an acoustic model and a dictionary;
and (3) meaning judgment: and obtaining an execution command matched with the information obtained by decoding in the operation of the information judgment algorithm.
For example, after the sound system 300 in this embodiment receives "yes" voice information of the passenger, the sound processing module 302 adjusts the voice information, extracts a feature vector, the sound recognition module 303 inputs the feature vector into the acoustic model, obtains phoneme information, queries the phoneme information in the dictionary, and sends "yes" matched text information as request information to the main control system 100.
The main control system 100 matches the corresponding instruction to "adjust seat" according to the received request message "yes", and then issues a backward adjustment action instruction to the seat system 400.
The sound collection module 301 in the sound system 300 maintains a state of collecting user voice information throughout the course of the adjustment of the seat system 400. When the user says "stop" is acquired, the main control system 100 issues an action instruction to stop the adjustment to the seat system 400, so that the seat adjustment is completed, as in the above-described method.
In order to verify and explain the technical effects adopted in the method, the technical scheme of the voice-adjusting automobile seat selected in the embodiment and the method are adopted for comparison test, and the test results are compared by means of scientific demonstration to verify the actual effects of the method.
The existing automobile seat is not particularly good in recognition effect on sound through voice adjustment, a certain time delay exists, whether a user is inconvenient to move or not cannot be recognized, accurate adjustment cannot be performed, and therefore user experience is not good.
In order to verify that the technical scheme of the method for adjusting the automobile seat relative to voice can quickly complete seat adjustment through voice instructions, in the embodiment, the prior technical scheme of the automobile seat adjusted by voice and the method are adopted to respectively carry out experimental comparison on the assistant driver seat of the simulation vehicle.
Firstly, adjusting an automobile co-driver by adopting a technical scheme of adjusting an automobile seat by voice, counting the time required by adjustment while speaking an instruction, and counting the adjustment condition after the adjustment is finished; then, the same seat is adjusted by adopting the method, at the moment, a user does not carry a large article, after adjustment is finished, the corresponding time and adjustment condition are recorded, and then the adjustment time and adjustment condition when the user carries the large article are recorded, wherein the large article is a cuboid with the length of 50cm and 100 cm; the results are shown in the following table.
Table 1: the technical scheme of the automobile seat is respectively adjusted by adopting the method and the voice to adjust the result comparison table of the same seat.
The table shows that the seat adjusting effect of the method is superior to the existing technical scheme of voice adjusting automobile seats when large articles are not carried, and the method can be intelligently adjusted according to the size of the carried articles after the large articles are carried, and the adjusting effect is still superior to the existing technical scheme of voice adjusting automobile seats.
Example 2
The present embodiment provides an automobile co-driver seat adjusting system, the structure of which is shown in fig. 1, comprising a vision system 200, an image processing module 202 and an image recognition module 203, wherein the vision system comprises an image acquisition module 201 arranged in an automobile, and the image processing module 202 and the image recognition module 203 are used for processing, recognizing and acquiring image information; the sound system 300 includes a sound collection module 301 provided in the vehicle, and a sound processing module 302 and a sound recognition module 303 for processing and recognizing voice information; the main control system 100 is connected with the vision system 200 and the sound system 300, and is used for receiving and processing information sent by the vision system 200 and the sound system 300 and sending a seat adjustment instruction to the seat system 400; the seat system 400 is disposed on the seat, connected to the master control system 100, and is configured to receive and execute a seat adjustment instruction sent by the master control system 100.
As shown in fig. 1, the vision system 200 in the present embodiment includes an image acquisition module 201, an image processing module 202, and an image recognition module 203. The image acquisition module 201 is a camera arranged in the vehicle and detects image information on a co-driver seat in the vehicle. The image processing module 202 is configured to convert the image information on the passenger seat into machine image information. The image recognition module 203 is configured to extract feature information in the machine image information.
Specifically, the image capturing module 201 in this embodiment is a CCD camera disposed in the vehicle, captures a picture or video on a passenger seat in the vehicle, and sends the capturing result to the image processing module 202 in a data manner for processing. The image processing module 202 and the image recognition module 203 are integrated on the same single chip microcomputer, and the same processor is responsible for executing operation. The image acquisition device in the vehicle can comprise a plurality of CCD cameras for acquiring environmental pictures in different directions. The camera in this embodiment is preferably used for collecting the front windshield, the a-pillar and the side window glass at the same time.
The main control system 100 in this embodiment includes a central processing unit 101, a receiving end, a transmitting end, and a memory, where the receiving end is connected with a transmitting end vision system 200 and a sound system 300; the receiving end and the sending end can be PCI-E, SATA, I/O, AUX and other types; the control instruction obtained after the information sent by the vision system 200200 and the sound system 300 reaches the central processing unit 101 for processing is used for executing the action of the seat system 400; the main control module is specifically positioned on the driving computer ECU and is responsible for supplying power by a vehicle-mounted power supply; the storage 102 is a vehicle-mounted hard disk and a random access memory, and is used for storing driving control system data and temporary data respectively.
The sound system 300 in this embodiment includes a sound collection module 301, a sound processing module 302, a sound recognition module 303, and a sound playing module; the sound collection module 301 is a microphone disposed in the vehicle, and the sound processing module 302 is configured to perform operations such as filtering, noise reduction, segmentation, etc. on the collected voice information, so that the original sound becomes available and calculated data; the voice recognition module 303 is configured to calculate the meaning text by using the acoustic model from the processed voice.
The seat system 400 comprises a seat mounted on a passenger car, a track is laid below the seat, the seat is driven by a stepping motor to linearly move on the track, and a control circuit diagram of the seat is shown in fig. 3. The stepping motor is connected with the programmable logic controller, and the working state of the stepping motor is controlled by the programmable logic controller. The programmable logic controller is connected with the main control system 100 and is used for receiving and executing the working instruction sent by the main control system 100.
In order to simplify the system in this embodiment, the vision system 200 in this embodiment is integrated on the central processor 101 of the main control system 100 and is located on the driving computer ECU, except for the image acquisition module 201 and the sound acquisition module 301 in the sound system 300.
As an alternative implementation manner, in order to make the processing speed of the vision system 200 faster in this embodiment, the image processing module 202 and the image recognition module 203 in the vision system 200 in this embodiment may be executed by a graphics processing, where the graphics processor and the central processor 101 are located in the driving computer ECU.
Example 3
The present embodiment is based on the adjustment method and system for the passenger seat of the automobile set forth in embodiment 1 and embodiment 2, and as shown in fig. 3, the following workflow is given:
step 1: the image acquisition module 201 constantly monitors whether the passenger seat needs to be placed with a large object. If yes, executing step 2, otherwise, continuing to execute step 1, and monitoring the co-driver seat.
Step 2: is the visual recognition module recognizing that there is sufficient space in the co-driver's seat? If yes, go to step 10. And if not, executing the step 3.
Step 3: the voice prompt "whether to move the passenger seat backward". Step 4 is continued.
Step 4: the sound system 300 listens for sounds and determines if there is a "yes" sound. If yes, go to step 6, and if not, go to step 5.
Step 5: determine if it times out? If yes, jumping to step 10, otherwise jumping to step 4.
Step 6: the sound playing module prompts that the user can shout to stop in the moving process. Step 7 is continued.
Step 7: the sound system 300 listens for sounds and determines if there is a "stop" sound. If so, go to step 9. If not, the process continues to step 8.
Step 8: the visual recognition module determines whether the secondary drive has been unable to move any more? If yes, step 9 is performed. If not, the process jumps to step 7.
Step 9: and finishing adjusting the co-driver's seat. The execution continues with step 10.
Step 10: and (5) ending.
It is important to note that the construction and arrangement of the present application as shown in a variety of different exemplary embodiments is illustrative only. Although only a few embodiments have been described in detail in this disclosure, those skilled in the art who review this disclosure will readily appreciate that many modifications are possible (e.g., variations in sizes, dimensions, structures, shapes and proportions of the various elements, values of parameters (e.g., temperature, pressure, etc.), mounting arrangements, use of materials, colors, orientations, etc.) without materially departing from the novel teachings and advantages of the subject matter described in this application. For example, elements shown as integrally formed may be constructed of multiple parts or elements, the position of elements may be reversed or otherwise varied, and the nature or number of discrete elements or positions may be altered or varied. Accordingly, all such modifications are intended to be included within the scope of present invention. The order or sequence of any process or method steps may be varied or re-sequenced according to alternative embodiments. In the claims, any means-plus-function clause is intended to cover the structures described herein as performing the recited function and not only structural equivalents but also equivalent structures. Other substitutions, modifications, changes and omissions may be made in the design, operating conditions and arrangement of the exemplary embodiments without departing from the scope of the present inventions. Therefore, the invention is not limited to the specific embodiments, but extends to various modifications that nevertheless fall within the scope of the appended claims.
Furthermore, in an effort to provide a concise description of the exemplary embodiments, all features of an actual implementation may not be described (i.e., those not associated with the best mode presently contemplated for carrying out the invention, or those not associated with practicing the invention).
It should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions may be made. Such a development effort might be complex and time consuming, but would nevertheless be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill having the benefit of this disclosure.
It should be noted that the above embodiments are only for illustrating the technical solution of the present invention and not for limiting the same, and although the present invention has been described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that the technical solution of the present invention may be modified or substituted without departing from the spirit and scope of the technical solution of the present invention, which is intended to be covered in the scope of the claims of the present invention.
Claims (4)
1. An automobile copilot seat adjusting method is characterized in that: comprising
The method comprises the steps that passenger seat information is collected, a vision system (200) collects image information of a passenger seat in a vehicle, the image information is processed into seat space parameters, and the seat space parameters are sent to a main control system (100);
the image information of the in-vehicle passenger seat is acquired by an image acquisition module (201) in the vision system (200);
the image acquisition module (201) acquires an image of a passenger on the front passenger seat, the image processing module (202) processes the image of the passenger in the passenger seat into machine image information, and then the image recognition module (203) extracts passenger characteristic information and sends the passenger characteristic information to the main control system (100);
the main control system (100) judges whether a passenger on the co-driver seat holds a large article according to the passenger characteristic information sent by the vision system (200), if so, the space size on the current co-driver seat is calculated and compared with a preset space threshold value, and if the space is smaller than the threshold value, the seat system (400) is ready to be started to adjust the seat;
the image recognition module (203) extracts the outline of the passenger in the image, and the main control system (100) recognizes whether the passenger holds a large article according to the outline;
inquiring the passengers, judging whether to adjust the seats or not by the main control system (100) according to the received seat space parameters, sending inquiry sentences to the passengers through the sound system (300), collecting voice instructions of the passengers, and determining whether to send adjustment action instructions to the seat system (400);
before adjusting the seat, the main control system (100) sends voice inquiry information to the sound system (300), a sound playing module in the sound system (300) plays the inquiry information to inquire whether a passenger needs to adjust the seat, and a sound collecting module (301) in the sound system (300) starts collecting voice information of the passenger;
after the voice acquisition module (301) acquires a voice instruction of a passenger, the voice processing module (302) adjusts the voice instruction into a machine language and transmits the machine language to the voice recognition module (303), the voice recognition module (303) extracts keywords and sends the keywords to the main control system (100) as request information;
and the seat system (400) executes the seat adjusting action according to the action adjusting instruction sent by the main control system (100) until a user sends a stopping instruction or the vision system (200) detects that the adjustment limit is reached, and the adjustment action is stopped.
2. The automobile co-pilot seat adjusting method according to claim 1, characterized in that: the main control system (100) judges whether a passenger needs to adjust the seat according to the received request information; if so, the seat is adjusted rearward to increase the passenger space.
3. The automobile co-pilot seat adjusting method according to claim 1, characterized in that: in the seat adjusting process, the vision system (200) collects image information of the position of the co-driver seat, sends the processed image information to the main control system (100), judges whether the seat reaches the limit position, and if so, stops seat adjustment; the sound system (300) collects voice information of a user and sends the voice information to the main control system (100) to judge that the adjustment is stopped when a passenger sends out the information, and if the passenger sends out a stop instruction, the adjustment of the seat is stopped.
4. A system employing the adjustment method of the passenger seat of the automobile as claimed in any one of claims 1 to 3, characterized in that: comprising the steps of (a) a step of,
a vision system (200) comprising an image acquisition module (201) arranged in a vehicle, an image processing module (202) and an image recognition module (203) for processing and recognizing acquired image information;
a sound system (300) including a sound collection module (301) provided in a vehicle, and a sound processing module (302) and a sound recognition module (303) for processing and recognizing voice information;
the main control system (100) is connected with the vision system (200) and the sound system (300) and is used for receiving and processing information sent by the vision system (200) and the sound system (300) and sending a seat adjustment instruction to the seat system (400);
and the seat system (400) is arranged on the seat, is connected with the main control system (100) and is used for receiving and executing the seat adjustment instruction sent by the main control system (100).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110874258.4A CN113771703B (en) | 2021-07-30 | 2021-07-30 | Automobile co-driver seat adjusting method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110874258.4A CN113771703B (en) | 2021-07-30 | 2021-07-30 | Automobile co-driver seat adjusting method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113771703A CN113771703A (en) | 2021-12-10 |
| CN113771703B true CN113771703B (en) | 2024-03-26 |
Family
ID=78836666
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110874258.4A Active CN113771703B (en) | 2021-07-30 | 2021-07-30 | Automobile co-driver seat adjusting method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113771703B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115071632B (en) * | 2022-06-22 | 2024-04-16 | 中国第一汽车股份有限公司 | Safety belt guide plate position adjusting method and device and vehicle |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001199264A (en) * | 2000-01-20 | 2001-07-24 | Takashimaya Nippatsu Kogyo Co Ltd | Seat for vehicle |
| JP2006142855A (en) * | 2004-11-16 | 2006-06-08 | Mazda Motor Corp | Vehicle mounted with seat device |
| JP2009202738A (en) * | 2008-02-27 | 2009-09-10 | Aisin Aw Co Ltd | Vehicular seat position adjustment device, vehicular seat position adjustment method, and vehicular seat position adjustment program |
| CN109130965A (en) * | 2018-10-23 | 2019-01-04 | 长春汽富晟李尔汽车座椅系统有限公司 | Automotive seat intelligence control system and the automotive seat for using the system |
| CN110271506A (en) * | 2018-03-13 | 2019-09-24 | 蔚来汽车有限公司 | Method and apparatus for automatically adjusting vehicle seat |
| CN110843614A (en) * | 2019-11-30 | 2020-02-28 | 的卢技术有限公司 | Self-adaptive adjusting method and system for automobile seat |
| KR102135261B1 (en) * | 2019-05-09 | 2020-07-17 | 엘지전자 주식회사 | Autonomous driving vehicle control method |
| CN112026686A (en) * | 2019-06-04 | 2020-12-04 | 上海汽车集团股份有限公司 | Method and device for automatically adjusting position of vehicle seat |
| CN112248886A (en) * | 2020-10-30 | 2021-01-22 | 西南交通大学 | A kind of seat automatic adjustment method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8457846B2 (en) * | 2010-05-14 | 2013-06-04 | Crane Co. | Modular seat actuation control system and communication method |
-
2021
- 2021-07-30 CN CN202110874258.4A patent/CN113771703B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001199264A (en) * | 2000-01-20 | 2001-07-24 | Takashimaya Nippatsu Kogyo Co Ltd | Seat for vehicle |
| JP2006142855A (en) * | 2004-11-16 | 2006-06-08 | Mazda Motor Corp | Vehicle mounted with seat device |
| JP2009202738A (en) * | 2008-02-27 | 2009-09-10 | Aisin Aw Co Ltd | Vehicular seat position adjustment device, vehicular seat position adjustment method, and vehicular seat position adjustment program |
| CN110271506A (en) * | 2018-03-13 | 2019-09-24 | 蔚来汽车有限公司 | Method and apparatus for automatically adjusting vehicle seat |
| CN109130965A (en) * | 2018-10-23 | 2019-01-04 | 长春汽富晟李尔汽车座椅系统有限公司 | Automotive seat intelligence control system and the automotive seat for using the system |
| KR102135261B1 (en) * | 2019-05-09 | 2020-07-17 | 엘지전자 주식회사 | Autonomous driving vehicle control method |
| CN112026686A (en) * | 2019-06-04 | 2020-12-04 | 上海汽车集团股份有限公司 | Method and device for automatically adjusting position of vehicle seat |
| CN110843614A (en) * | 2019-11-30 | 2020-02-28 | 的卢技术有限公司 | Self-adaptive adjusting method and system for automobile seat |
| CN112248886A (en) * | 2020-10-30 | 2021-01-22 | 西南交通大学 | A kind of seat automatic adjustment method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113771703A (en) | 2021-12-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110047487B (en) | Wake-up method and device for vehicle-mounted voice equipment, vehicle and machine-readable medium | |
| CN106816149B (en) | Prioritized content loading for vehicle automatic speech recognition systems | |
| CN108725357B (en) | Parameter control method and system based on face recognition and cloud server | |
| KR102437833B1 (en) | Apparatus for selecting at least one task based on voice command, a vehicle including the same and a method thereof | |
| US20180350366A1 (en) | Situation-based conversation initiating apparatus, system, vehicle and method | |
| DE102008034143B4 (en) | Method for ambient noise coupling for speech recognition in a production vehicle | |
| JP6977004B2 (en) | In-vehicle devices, methods and programs for processing vocalizations | |
| CN110660397A (en) | Dialogue system, vehicle, and method for controlling vehicle | |
| CN109545219A (en) | Vehicle-mounted voice interaction method, system, equipment and computer readable storage medium | |
| CN112397065A (en) | Voice interaction method and device, computer readable storage medium and electronic equipment | |
| DE102019105269A1 (en) | VOICE RECOGNITION arbitration logic | |
| DE102018125966A1 (en) | SYSTEM AND METHOD FOR RECORDING KEYWORDS IN A ENTERTAINMENT | |
| CN110460921A (en) | A kind of pick-up control method, device, vehicle and storage medium | |
| DE102018103188A1 (en) | Improved task completion in speech recognition | |
| CN113771703B (en) | Automobile co-driver seat adjusting method and system | |
| CN115312061A (en) | Voice question-answer method and device in driving scene and vehicle-mounted terminal | |
| CN109979452A (en) | Vehicle-mounted robot natural language processing method, computer device and computer readable storage medium | |
| US9830925B2 (en) | Selective noise suppression during automatic speech recognition | |
| CN109878290B (en) | AI technology-based intelligent vehicle-mounted air conditioner control method and system | |
| US10289919B2 (en) | Vehicle and method of controlling the same | |
| CN113879235A (en) | Method, system, equipment and storage medium for multi-screen control of automobile | |
| CN112331200A (en) | A vehicle-mounted voice control method | |
| JPH11352987A (en) | Voice recognition device | |
| CN111866382A (en) | Method for acquiring image, electronic device and computer readable storage medium | |
| US20230298581A1 (en) | Dialogue management method, user terminal and computer-readable recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |