AU2015100797B4 - Vehicle training system - Google Patents
Vehicle training system Download PDFInfo
- Publication number
- AU2015100797B4 AU2015100797B4 AU2015100797A AU2015100797A AU2015100797B4 AU 2015100797 B4 AU2015100797 B4 AU 2015100797B4 AU 2015100797 A AU2015100797 A AU 2015100797A AU 2015100797 A AU2015100797 A AU 2015100797A AU 2015100797 B4 AU2015100797 B4 AU 2015100797B4
- Authority
- AU
- Australia
- Prior art keywords
- vehicle
- trainer
- images
- display
- operating station
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired
Links
- 238000012549 training Methods 0.000 title claims abstract description 26
- 238000004891 communication Methods 0.000 claims abstract description 29
- 238000005065 mining Methods 0.000 claims abstract description 8
- 238000010276 construction Methods 0.000 claims abstract description 5
- 238000012544 monitoring process Methods 0.000 claims description 13
- 230000001755 vocal effect Effects 0.000 claims description 2
- 230000008901 benefit Effects 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 238000000034 method Methods 0.000 description 3
- 241001124569 Lycaenidae Species 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 239000004557 technical material Substances 0.000 description 1
- 238000001931 thermography Methods 0.000 description 1
Landscapes
- Closed-Circuit Television Systems (AREA)
Abstract
Abstract The present invention provides a vehicle training system, in particular for a dozer or a grader used in agricultural, mining or construction operations. The system comprises one or more cameras positioned at a vehicle operating station, to obtain images associated with a trainee vehicle operator. The system also comprises a display device, remote from the vehicle operating station, to display the images to a trainer. Communication apparatus transmits the images from the cameras to the display device. An input device receives input (e.g. spoken instructions) from the trainer and it is transmitted to the trainee. The system may further include obtaining vehicle diagnostic data and vibration data, and displaying that information to the trainer on the display device.
Description
Vehicle Training System
Field of the invention [0001] The present invention relates to a vehicle training system. It has particular application to vehicles having a single person cab, and in particular to dozers and graders, as well as other vehicles used in the mining, construction and agricultural industries.
Background of the invention [0002] Many large vehicles, particularly those used in the agricultural, mining and construction industries, can require significant training to operate effectively and efficiently. However, many of these large vehicles (such as harvesters, cranes, dozers and graders) only have single person cabins. Therefore, when training a new vehicle operator, both trainee and trainer face difficulties in, respectively, learning and teaching correct operation of the vehicle. The trainer must infer what the trainee is doing from outside the cabin, while the trainee lacks feedback and guidance to assist them in operating the vehicle.
[0003] There is a need for improved mechanisms to provide facilitate training of vehicle operators, particularly in relation to vehicles with single person cabins.
Summary of the invention [0004] According to a first aspect of the present invention, there is provided a vehicle training system comprising: (a) one or more cameras positioned at a vehicle operating station, to obtain images associated with a trainee vehicle operator; (b) a display device, remote from the vehicle operating station, to display the images to a trainer; (c) an input device associated with the display to receive input from the trainer including verbal input; (d) an output device positioned at the vehicle operating station; (e) vehicle monitoring apparatus to obtain real-time vehicle status data, and (f) communication apparatus configured to transmit the images from the cameras to the display device, to transmit the input from the trainer to the output device at the vehicle operating station and to transmit the vehicle status data to the display device, for display contemporaneous with the images.
[0005] The invention has application in particular to training operators of dozers and graders. The invention also has wider application to other heavy vehicles such as cranes, harvesters, excavators or mining trucks, other vehicles with single person cabins, and in fact other vehicle training applications where it is desirable or necessary for the trainer to be located remote from the trainee.
[0006] The cameras are preferably directed to obtain images that show (at least in part) the inside of the vehicle operating station (e.g. the vehicle cabin), and the images transmitted in real-time to the display. This allows the trainer to observe the actions of the trainee, from a remote location.
[0007] The system may further comprise vehicle monitoring apparatus to obtain realtime vehicle status data. This may include built-in diagnostic systems associated with the vehicle. In that case, the communication apparatus is configured to transmit the vehicle status data to the display device, for display contemporaneous with the images.
[0008] The input device may comprise a microphone, and the output device may comprise a speaker. In that case, the communication apparatus may provide a voice over wireless link such that the trainer can communicate by voice to the trainee vehicle operator.
[0009] The communication apparatus may comprise wireless transmitters and receivers positioned at the vehicle operating station and the trainer location. However, the trainer location may be mobile. For example, the microphone, display apparatus and part of the communication apparatus may be assembled in a mobile computing device such as a mobile phone, tablet or laptop computer. The trainer can therefore monitor the trainee vehicle operator while they are mobile - for example, while following the trainee in their own car.
[0010] The system may comprises vibration monitoring apparatus to provide vibration data for the vehicle operating station, and the communication apparatus may further be configured to transmit the vibration data to the display device, for display contemporaneous with the images.
[0011] In a further aspect of the present invention, there is provided a control unit for use in such a vehicle training system. The control unit may be adapted to receive images from one or more cameras, vehicle status data from vehicle monitoring apparatus, and vibration data from vibration monitoring apparatus, and to transmit that information to a remote computing device for viewing by a trainer.
[0012] In a further aspect of the present invention, there is provided a mobile computing device for use by a trainer in such a vehicle training system.
[0013] A detailed description of one or more embodiments of the invention is provided below, along with accompanying figures that illustrate by way of example the principles of the invention. While the invention is described in connection with such embodiments, it should be understood that the invention is not limited to any embodiment. On the contrary, the invention encompasses numerous alternatives, modifications and equivalents.
[0014] For the purpose of example, numerous specific details are set forth in the following description in order to provide a thorough understanding of the present invention. The present invention may be practiced according to the claims without some or all of these specific details. For the purpose of clarity, technical material that is known in the technical fields related to the invention has not been described in detail so that the present invention is not unnecessarily obscured.
Brief Description of Drawings [0015] Various embodiments/aspects of the invention will now be described with reference to the following drawings in which: [0016] Figure 1 is a schematic design diagram of a vehicle training system according to a representative embodiment of the present invention; [0017] Figure 2 is a perspective view of a control unit and cameras for use in a vehicle training system according to a representative embodiment of the present invention; and [0018] Figure 3 is a screenshot of a display of a mobile computing device, for use in a vehicle training system according to a representative embodiment of the present invention.
Detailed Description [0019] Referring to figure 1, there is shown a vehicle training system 100 according to a representative embodiment of the present invention. The vehicle training system 100 comprises a control unit 200, for positioning at a vehicle operating station. The control unit 200 is shown in Figure 2, along with a number of cameras 300 that can be stored with the control unit 200. The control unit 200 itself includes computer processing hardware, such as a processor and a memory in communication with the processor. The control unit also includes a wireless transmitter 210 and receiver 220, and a speaker 230, as shown in Figure 1. A recording medium may also be provided, to record the images - e.g. the control unit 200 may have DVR capability.
[0020] In operation, the cameras 300 are installed at the vehicle operating station (e.g. within the cabin of the vehicle). In this embodiment, the cameras 300 are mini-conch dome cameras, which preferably are capable of operating in volatile and high vibration environments as found within heavy agricultural, mining or construction vehicles. The cameras 300, once operating, capture images (preferably video footage) associated with the vehicle operating station. These may include images showing the trainee vehicle operator operating the vehicle, but the images may also show views of what the trainee vehicle operator sees as he operates the vehicle (e.g. looking out of the cabin).
[0021] In this embodiment, the cameras operate in the visible light range. However, other types of cameras operating in different frequency ranges, such as thermal imaging cameras, may also be used. These cameras give particular advantages in low visibility conditions (e.g. low light or dusty conditions).
[0022] A communication link is provided between cameras 300 and control unit 200. This may comprise a cable connection from the cameras 300 to input/output sockets 230 on control unit 200. The images from the cameras 300 are then transmitted via transmitter 210 to a receiver 420 of a remote mobile computing device 400, and displayed on a display 440. A trainer can view the images on the display 440.
[0023] Of course, in different embodiments of the present invention, the trainer station need not be mobile, and could be a fixed computing device such as a desktop PC.
However, preferably a mobile computing device 400 such as a laptop is used, which allows the trainer to monitor the trainee from a variety of locations, including from the trainer's own vehicle. The trainer can therefore follow the trainee vehicle operator in their own vehicle. The camera images can then give the trainer a better real-time understanding of what is occurring inside the vehicle cabin, while the trainer can independently observe the working of the vehicle from the outside.
[0024] Of particular note, this embodiment of the present invention also allows feedback to provided from the trainer to the trainee, in real-time. The trainer can give spoken instructions into microphone 430, which are transmitted by transmitter 410 to the receiver 220 of control unit 200, and output to the trainee via speaker 230. This may be through known voice over wireless/VoIP protocols. In this way, the trainee is able to obtain real-time and immediate guidance from the trainer, while operating the vehicle.
[0025] In one embodiment, both trainer and trainee will be provided with handsets or headsets, each containing a microphone and speaker(s), to enable voice communication in both directions via the communication apparatus.
[0026] Feedback may be given from the trainer to the trainee in other forms - e.g. if there is a visual display at the vehicle operating station, feedback may be provided via onscreen text or images. However, compared to audio feedback, visual feedback may be more difficult for the trainee to view whilst operating the vehicle.
[0027] The present invention provides an advantage over current training methods not only because the trainee is given real-time feedback, but also because the trainer is given more information to understand errors made by the trainee, or difficulties they are having. In this embodiment, this information is provided on a real-time basis, and is provided even if the trainer is located remotely from the vehicle itself.
[0028] However, these advantages may be increased by displaying more information to the trainer. Accordingly, the vehicle training system 100 may include vehicle diagnostic apparatus 500, which measures the position of the various vehicle settings. For example, for a dozer or grader, this may include direct measurements of the blade height and angle, the rpm of the engine, the speed of the vehicle, battery status, steering position, panic button status, and other measurements relating to the vehicle operation (covering, for example, any information displayed on the vehicle dashboard). Collectively, this specification refers to such measurements as vehicle status data.
[0029] The vehicle status data can be obtained from sensors and instruments on the vehicle. These types of systems have been used for maintenance purposes for heavy vehicles; however, in this embodiment of the present invention, the vehicle monitoring apparatus is connected to the control unit 200 (e.g. by cable to input/output interface 240) to provide vehicle status data in real-time, which is transmitted by the communication apparatus (from transmitter 410 to receiver 420) to the trainer's mobile computing device 400. The information can then be displayed on display 440, preferably contemporaneously with images from the cameras 300. As shown in Figure 3, the images 442 from four cameras are displayed to the trainer, as well as a dashboard 445 beneath the images which can be used to show the vehicle status data. In other embodiments, a different number of cameras may be used and their footage displayed on the display 440.
[0030] Displaying this information allows the trainer to not only see what is happening at the vehicle operating station, but also to access vehicle status data that is ordinarily only accessible to the vehicle operator him- or herself. By better informing the trainer, the trainer can provide better feedback to the trainee, and more quickly identify operating techniques that need correction or improvement.
[0031] Furthermore, in heavy vehicles such as dozers or graders, vibration is an important occupational health and safety issue - it is important to monitor and preferably control the amount of vibration experienced by a vehicle operator. In particular, it is important to monitor the whole body vibration experienced by the operator. Accordingly, the vehicle training system 100 of the preferred embodiment of the present invention incorporates vibration monitoring apparatus 600. The vibration monitoring apparatus 600 may be positioned, for example, on or in the operator's seat in the vehicle cabin, and may measure vibration in three dimensions. Vibration data obtained from the vibration monitoring apparatus may be transmitted to the mobile computing device 200 via control unit 200, for display to the trainer on display 440.
[0032] By displaying vibration data contemporaneous with vehicle status data and images from the cameras 300, the trainer can monitor the trainee's operating techniques and observe any operating practices that are associated with excessive vibration. The trainer can then provide feedback to the trainee, highlighting the issue causing the excessive vibration and helping to correct it.
[0033] The communication apparatus is preferably wireless. It may comply with current protocols for wireless transmission, such as 3G, 4G or WiFi protocols. Preferably, however, the wireless transmission is a direct WiFi connection, or another communication protocol that is independent of third party (e.g. government) infrastructure. Many agricultural and mining activities take place in relatively remote locations, that (for example) are not heavily serviced by third party telephone networks. Accordingly, the wireless transmitters and receivers may operate at 900MHz using WiFi communication protocols, that allow for data (and voice over wireless) communication without reliance on a telephone network.
[0034] Furthermore, although Figure 1 depicts (for simplicity) the display device 440 and transmitter 410 and receiver 420 as being assembled into a mobile computing device 400, which communicates directly with the control unit, other embodiments are possible. For example, the trainer station may include a mobile computing device having a 2400MHz WiFi transmitter and receiver unit, and also an intermediate communication unit having both 900MHz WiFi transmitter and receiver and 2400MHZ WiFi transmitter and receiver. In this way, the intermediate communication unit may be taken to a location that is within communication range of the control unit at 900MHz. The trainer may then move around with the mobile computing device, away from the communication unit. The mobile computing device would communicate directly with the intermediate communication unit using the 2400MHz WiFi transmitter and receiver units. The intermediate communication unit would in turn interface to the control unit at the vehicle operating station. This approach can extend the range and mobility of the vehicle training system.
[0035] Other types of data may also be provided to the control unit and transmitted to the trainer's computing device by the communication apparatus - for instance, GPS data.
[0036] As the present invention may be embodied in several forms without departing from the essential characteristics of the invention, it should be understood that the above described embodiments should not be considered to limit the present invention but rather should be construed broadly. Various modifications, improvements and equivalent arrangements will be readily apparent to those skilled in the art, and are intended to be included within the spirit and scope of the invention.
[0037] The word ‘comprising’, and forms of the word ‘comprising’, when used in this specification is taken to specify the presence of stated features, integers, steps or components but does not preclude the presence or addition of one or more other features, integers, steps, components or groups thereof.
[0038] In this specification where a document, act or item of knowledge is referred to or discussed, this reference or discussion is not an admission that the document, act or item of knowledge or any combination thereof was at the priority date, publicly available, known to the public, part of the common general knowledge; or known to be relevant to an attempt to solve any problem with which this specification is concerned.
Claims (5)
- The claims defining the invention are as follows:1. A vehicle training system comprising: (a) one or more cameras positioned at a vehicle operating station, to obtain images associated with a trainee vehicle operator; (b) a display device, remote from the vehicle operating station, to display the images to a trainer; (c) an input device associated with the display to receive input from the trainer including verbal input; (d) an output device positioned at the vehicle operating station; (e) vehicle monitoring apparatus to obtain real-time vehicle status data,; and (f) communication apparatus configured to transmit the images from the cameras to the display device, to transmit the input from the trainer to the output device at the vehicle operating station and to transmit the vehicle status data to the display device, for display contemporaneous with the images.
- 2. The vehicle training system of claim 1, wherein the display device, the input device and at least part of the communication apparatus are assembled in a mobile computing device, such that the trainer can monitor the trainee vehicle operator while mobile.
- 3. The vehicle training system of any preceding claim, further comprising: (g) vibration monitoring apparatus to provide vibration data for the vehicle operating station, and wherein the communication apparatus is further configured to transmit the vibration data to the display device, for display contemporaneous with the images.
- 4. The vehicle training system accordingly to any preceding claim wherein the vehicle is a heavy agricultural, mining or construction vehicle including a crane, a harvester, an excavator, mining truck, dozer and a grader.
- 5. A control unit for use in a vehicle training system, and for positioning at a vehicle operating station, the control unit comprising: a processor; a memory; an input/output interface adapted to connect to the following: (i) one or more cameras, to receive images therefrom; and (ii) vehicle monitoring apparatus, to receive vehicle status data therefrom; and, optionally (iii) vibration monitoring apparatus, to receive vibration data therefrom; a speaker; and wireless communication apparatus to provide a two-way communication link between the control unit and a remote computing device used by a trainer, wherein the communication apparatus is configured to transmit the images, and the vehicle status data and optionally the vibration data to the remote computing device, and is configured to receive audio data from the remote computing device, and wherein the control unit is further configured to play the audio data received from the remote computing device through the speaker.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| AU2015100797A AU2015100797B4 (en) | 2015-06-12 | 2015-06-12 | Vehicle training system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| AU2015100797A AU2015100797B4 (en) | 2015-06-12 | 2015-06-12 | Vehicle training system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| AU2015100797A4 AU2015100797A4 (en) | 2015-07-23 |
| AU2015100797B4 true AU2015100797B4 (en) | 2016-06-09 |
Family
ID=53577861
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| AU2015100797A Expired AU2015100797B4 (en) | 2015-06-12 | 2015-06-12 | Vehicle training system |
Country Status (1)
| Country | Link |
|---|---|
| AU (1) | AU2015100797B4 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107862934A (en) * | 2017-11-23 | 2018-03-30 | 安徽枫雅轩科技信息服务有限公司 | Rail traffic vehicles network actual training device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0290364A1 (en) * | 1987-04-29 | 1988-11-09 | Sarl France Pilotage Systemes | Apparatus for learning how to drive a car |
| US6389339B1 (en) * | 1999-11-24 | 2002-05-14 | William J. Just | Vehicle operation monitoring system and method |
| EP1306278A2 (en) * | 2001-10-23 | 2003-05-02 | Karlheinz Pilz | Control device for a driving school vehicle and affiliated driving instructor post |
| WO2011126379A1 (en) * | 2010-04-04 | 2011-10-13 | Driving Performance Solutions As | A system and method for drivers training |
| US20120021386A1 (en) * | 2007-08-01 | 2012-01-26 | Airmax Group Plc | Method and apparatus for providing information about a vehicle |
-
2015
- 2015-06-12 AU AU2015100797A patent/AU2015100797B4/en not_active Expired
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0290364A1 (en) * | 1987-04-29 | 1988-11-09 | Sarl France Pilotage Systemes | Apparatus for learning how to drive a car |
| US6389339B1 (en) * | 1999-11-24 | 2002-05-14 | William J. Just | Vehicle operation monitoring system and method |
| EP1306278A2 (en) * | 2001-10-23 | 2003-05-02 | Karlheinz Pilz | Control device for a driving school vehicle and affiliated driving instructor post |
| US20120021386A1 (en) * | 2007-08-01 | 2012-01-26 | Airmax Group Plc | Method and apparatus for providing information about a vehicle |
| WO2011126379A1 (en) * | 2010-04-04 | 2011-10-13 | Driving Performance Solutions As | A system and method for drivers training |
Also Published As
| Publication number | Publication date |
|---|---|
| AU2015100797A4 (en) | 2015-07-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9544305B2 (en) | Server and method of providing server-based car security service, car device and method of using server-based car security service, user device and method of using server-based car security service | |
| JP2020513617A (en) | Method for confirming driving action, device, device and storage medium | |
| JP5369057B2 (en) | Work machine ambient monitoring device | |
| US20170293809A1 (en) | Driver assistance system and methods relating to same | |
| US20150360618A1 (en) | Field of Vision Display Device for a Sun Visor of a Vehicle | |
| US9934629B2 (en) | Vehicle maintenance system and method | |
| AU2020385740B2 (en) | Remote work support system | |
| US20130222590A1 (en) | Methods and apparatus for dynamically simulating a remote audiovisual environment | |
| KR20160045342A (en) | Apparatus and Method for Controlling of Vehicle Using Wearable Device | |
| US20220301270A1 (en) | Systems and methods for immersive and collaborative video surveillance | |
| US10664711B2 (en) | Vehicle prompt apparatus and operating method thereof | |
| CN114661026A (en) | Interactive vehicle remote diagnosis method and system based on augmented reality and storage medium thereof | |
| AU2015100797B4 (en) | Vehicle training system | |
| US20220263980A1 (en) | System and method for a multi-user remote controllable safety camera | |
| CN110942023A (en) | Indication method, device and equipment for vehicle vision blind area and storage medium | |
| JP7171208B2 (en) | Work support device for construction machinery | |
| KR20170105927A (en) | A works monitoring system using unmanned aerial vehicle | |
| JP2012073841A (en) | Patrol inspection system | |
| US20170320435A1 (en) | WiFi Wireless Rear View Parking System | |
| US20130238185A1 (en) | Car video device enabling wireless transmission to and from portable communication device | |
| CN109345858B (en) | Motorcade monitoring system | |
| JP2003308117A (en) | Maintenance system | |
| JP5951860B1 (en) | Maintenance support system and maintenance support information processing method | |
| DE112008003763T5 (en) | Communication system for use with a vehicle | |
| US8140137B2 (en) | Compact display unit |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| FGI | Letters patent sealed or granted (innovation patent) | ||
| FF | Certified innovation patent | ||
| MK22 | Patent ceased section 143a(d), or expired - non payment of renewal fee or expiry |