TWI824683B - Screen unit management method, electronic apparatus, and non-transitory computer-readable storage medium - Google Patents
Screen unit management method, electronic apparatus, and non-transitory computer-readable storage medium Download PDFInfo
- Publication number
- TWI824683B TWI824683B TW111132289A TW111132289A TWI824683B TW I824683 B TWI824683 B TW I824683B TW 111132289 A TW111132289 A TW 111132289A TW 111132289 A TW111132289 A TW 111132289A TW I824683 B TWI824683 B TW I824683B
- Authority
- TW
- Taiwan
- Prior art keywords
- image
- screen
- area
- management method
- screen unit
- Prior art date
Links
- 238000007726 management method Methods 0.000 title claims abstract description 50
- 238000001514 detection method Methods 0.000 claims description 36
- 230000000873 masking effect Effects 0.000 claims description 19
- 230000000903 blocking effect Effects 0.000 claims description 6
- 230000001186 cumulative effect Effects 0.000 claims 2
- 238000000034 method Methods 0.000 abstract description 11
- 238000010586 diagram Methods 0.000 description 14
- 230000007246 mechanism Effects 0.000 description 6
- 230000036544 posture Effects 0.000 description 5
- 230000001815 facial effect Effects 0.000 description 4
- 238000003825 pressing Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 206010068906 Computer vision syndrome Diseases 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 230000001886 ciliary effect Effects 0.000 description 2
- 230000000875 corresponding effect Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 210000003205 muscle Anatomy 0.000 description 2
- 238000011895 specific detection Methods 0.000 description 2
- 208000008035 Back Pain Diseases 0.000 description 1
- 208000035473 Communicable disease Diseases 0.000 description 1
- 206010019233 Headaches Diseases 0.000 description 1
- 206010028836 Neck pain Diseases 0.000 description 1
- 208000002193 Pain Diseases 0.000 description 1
- 206010047513 Vision blurred Diseases 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 231100000869 headache Toxicity 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000007480 spreading Effects 0.000 description 1
- 208000024891 symptom Diseases 0.000 description 1
- 208000008918 voyeurism Diseases 0.000 description 1
Images
Landscapes
- User Interface Of Digital Computer (AREA)
- Telephone Function (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Description
本發明是有關於一種電子裝置的使用方式的管理技術,且特別是有關於一種螢幕單元管理方法、電子裝置及非暫態電腦可讀取儲存媒體。The present invention relates to a management technology for how an electronic device is used, and in particular, to a screen unit management method, an electronic device and a non-transitory computer-readable storage medium.
傳染性疾病的疫情蔓延多時,使得遠距工作成為新常態。甚至,居家辦公(Work From Home,WFH)或居家學習(Learn From Home,LFH)可能轉變為更靈活的隨處辦公(Work From Anywhere,WFA)與隨處學習(Learn From Anywhere,LFA)。由於工作或是教學方式有彈性的優點,因此線上辦公與線上學習的狀態仍然普遍發生於各國。The epidemic of infectious diseases has been spreading for a long time, making remote work the new normal. Even Work From Home (WFH) or Learn From Home (LFH) may transform into more flexible Work From Anywhere (WFA) and Learn From Anywhere (LFA). Due to the advantages of flexible working or teaching methods, online office and online learning are still common in various countries.
相較於疫情前,人們花了更多時間使用電子裝置以進行辦公或學習。在長時間使用電子裝置來工作與學習的情況下,有近9成的用戶都曾經歷電腦視覺症候群(Computer Vision Syndrome,CVS)。錯誤的姿勢、太近的距離、過度使用等因素,都有可能導致用戶患上CVS,從而出現視力下降與模糊、眼睛灼熱或刺痛、對光敏感、出現頭痛、背部和頸部疼痛等症狀。現有裝置並無法主動地防範用戶以錯誤姿勢使用裝置,也無法主動地讓用戶控制使用裝置的時間。Compared with before the epidemic, people spend more time using electronic devices for work or study. Nearly 90% of users have experienced Computer Vision Syndrome (CVS) after using electronic devices for long periods of time to work and study. Wrong posture, too close distance, overuse and other factors may cause users to suffer from CVS, resulting in decreased and blurred vision, burning or stinging eyes, sensitivity to light, headaches, back and neck pain and other symptoms. . Existing devices cannot actively prevent users from using the device in incorrect postures, nor can they actively allow users to control the time they use the device.
另一方面,若資訊頻繁透過線上方式傳遞,則資安事件發生的機率也會大幅升高。隨處辦公與隨處學習可能會到各個地點進行工作與學習。因此,除了從網路端控管資訊安全,更需要嚴加防範現場螢幕資訊外洩的風險。現有裝置並無法在不影響螢幕觀看視角以及亮度下,主動地防範來自外界的窺視。On the other hand, if information is frequently transmitted online, the probability of information security incidents will also increase significantly. Work and study anywhere. You may work and study in various places. Therefore, in addition to controlling information security from the Internet, it is also necessary to strictly prevent the risk of on-site screen information leakage. Existing devices cannot actively prevent prying eyes from the outside world without affecting the viewing angle and brightness of the screen.
有鑑於此,本發明實施例提供一種螢幕單元管理方法、電子裝置及非暫態電腦可讀取儲存媒體,可主動地管制螢幕單元的使用。In view of this, embodiments of the present invention provide a screen unit management method, an electronic device, and a non-transitory computer-readable storage medium that can actively control the use of screen units.
本發明實施例的螢幕單元管理方法包括(但不僅限於)下列步驟:顯示原始畫面;辨識偵測資料中的第一圖像;判斷第一圖像,是否符合註冊圖像。依據第一圖像的判斷結果,遮蔽原始畫面。The screen unit management method in the embodiment of the present invention includes (but is not limited to) the following steps: display the original screen; identify the first image in the detection data; determine whether the first image matches the registered image. According to the judgment result of the first image, the original picture is blocked.
本發明實施例的電子裝置包括(但不僅限於)螢幕單元、感測單元、記憶單元及處理單元。螢幕單元用以顯示原始畫面。感測單元用以取得偵測資料。記憶單元用於儲存程式碼。處理單元用以載入且執行程式碼,以實現如上述的螢幕單元管理方法。The electronic device according to the embodiment of the present invention includes (but is not limited to) a screen unit, a sensing unit, a memory unit and a processing unit. The screen unit is used to display the original screen. The sensing unit is used to obtain detection data. Memory cells are used to store program code. The processing unit is used to load and execute the program code to implement the above-mentioned screen unit management method.
本發明實施例的非暫態電腦可讀取儲存媒體用於儲存程式碼。處理單元載入程式碼以執行如上述的螢幕單元管理方法。The non-transitory computer-readable storage medium of the embodiment of the present invention is used to store program codes. The processing unit loads code to perform the screen unit management method as described above.
基於上述,依據本發明實施例的螢幕單元管理方法、非暫態電腦可讀取記憶單元、電子裝置及非暫態電腦可讀取儲存媒體,比對圖像,並據以遮蔽原始畫面。藉此,可提供自動化的螢幕單元管理機制。Based on the above, according to the screen unit management method, the non-transitory computer readable memory unit, the electronic device and the non-transitory computer readable storage medium according to the embodiments of the present invention, the images are compared and the original screen is masked accordingly. This provides an automated screen unit management mechanism.
為讓本發明的上述特徵和優點能更明顯易懂,下文特舉實施例,並配合所附圖式作詳細說明如下。In order to make the above-mentioned features and advantages of the present invention more obvious and easy to understand, embodiments are given below and described in detail with reference to the accompanying drawings.
圖1A是依據本發明一實施例的電子裝置10的元件方塊圖。請參照圖1A,電子裝置10包括(但不僅限於)螢幕單元11、感測單元12、記憶單元13及處理單元14。電子裝置10可以是個人電腦、筆記型電腦、平板電腦、智慧型手機、語音助理裝置或智能家電。FIG. 1A is a block diagram of an
螢幕單元11可以是液晶顯示器(Liquid-Crystal Display,LCD)、發光二極體(Light-Emitting Diode,LED)顯示器、有機發光二極體(Organic Light-Emitting Diode,OLED)顯示器或其他顯示器。在一實施例中,螢幕單元11用以顯示圖片、文字、影片、用戶介面或其組合的畫面。The
感測單元12可以是近接感測器、紅外線相機或彩色相機或其組合。在一實施例中,感測單元12用以取得原始資料。例如,感測單元12的原始資料為強度、像素位置、色階或其組合。原始資料可經處理或直接輸出,以作為偵測資料。例如,偵測資料為距離、位置、方向、顏色、圖案、物件類型、人物及/或特定手勢。也就是,偵測資料包括感測單元12的原始資料。The
記憶單元13可以是任何型態的固定或可移動隨機存取記憶體(Radom Access Memory,RAM)、唯讀記憶體(Read Only Memory,ROM)、快閃記憶體(flash memory)、傳統硬碟(Hard Disk Drive,HDD)、固態硬碟(Solid-State Drive,SSD)或類似元件。在一實施例中,記憶單元13用於儲存程式碼、軟體模組、組態配置、資料(例如,註冊圖像、管理條件、或偵測資料)或檔案,並待後續實施例詳述。The
處理單元14耦接螢幕單元11、感測單元12及記憶單元13。處理器17可以是中央處理單元(Central Processing Unit,CPU)、圖形處理單元(Graphic Processing unit,GPU),或是其他可程式化之一般用途或特殊用途的微處理器(Microprocessor)、數位信號處理器(Digital Signal Processor,DSP)、可程式化控制器、現場可程式化邏輯閘陣列(Field Programmable Gate Array,FPGA)、特殊應用積體電路(Application-Specific Integrated Circuit,ASIC)或其他類似元件或上述元件的組合。在一些實施例中,處理單元14的功能可實現在軟體或積體電路上。在一實施例中,處理單元14用以執行電子裝置10的所有或部份作業,且可載入並執行記憶單元13所儲存的程式碼,以執行或實現本發明實施例的方法流程。The
圖1B是依據本發明一實施例的電子裝置的示意圖。請參照圖1B,電子裝置10包括第一機體15及第二機體16。第一機體15用以容置螢幕單元11與感測單元12。第二機體16(例如透過轉軸)樞接於第一機體15,且用以容置記憶單元13與處理單元14。例如,第一機體15是電子裝置10的A面及B面所形成的機殼,且第二機體16是電子裝置10的C面及D面所形成的機殼。FIG. 1B is a schematic diagram of an electronic device according to an embodiment of the present invention. Referring to FIG. 1B , the
下文中,將搭配電子裝置10中的各項裝置、元件及模組說明本發明實施例所述的方法。本方法的各個流程可依照實施情形而調整,且並不僅限於此。In the following, the method described in the embodiment of the present invention will be described with reference to various devices, components and modules in the
圖2是依據本發明一實施例的螢幕單元管理方法的流程圖。請參照圖2,處理單元14透過螢幕單元11顯示原始畫面(步驟S210)。原始畫面可以是圖片、文字、影片、遊戲、用戶介面或其組合。例如,文書程式的編輯畫面、郵件程式的主介面、或視訊通話的對方影像。FIG. 2 is a flow chart of a screen unit management method according to an embodiment of the present invention. Referring to FIG. 2 , the
處理單元14辨識偵測資料中的第一圖像(步驟S220)。在一實施例中,偵測資料包括近接感測器、紅外線相機或彩色相機的偵測資料。例如,基於近接感測器的阻抗、電容或開關狀態可用於偵測用戶與感測單元12之間距離及/或用戶是否存在。又例如,紅外線相機的感測圖像可用於偵測面部訊息(提供較高隱私度)、偵測用戶與感測單元12之間距離及/或偵測用戶是否存在。再例如,彩色相機的彩色圖像可用於偵測用戶於整個拍攝畫面中之位置資訊、偵測面部訊息(隱私強度相較於紅外線相機更弱)及/或偵測用戶是否存在。The
而本實施例有面部訊息及/或物件特徵的偵測的需求,因此偵測資料可以是紅外線相機或彩色相機的偵測資料。This embodiment has the requirement to detect facial information and/or object characteristics, so the detection data can be detection data from an infrared camera or a color camera.
圖3A至圖3D是依據本發明一實施例的第一圖像的示意圖。請參照圖3A,第一圖像可以是第一用戶圖像UI1。用戶圖像是指人物的圖像。例如,透過感測單元12拍攝用戶所取得的圖像。3A to 3D are schematic diagrams of a first image according to an embodiment of the present invention. Referring to FIG. 3A, the first image may be the first user image UI1. A user image refers to an image of a person. For example, the image obtained by the user is captured through the
在一實施例中,第一用戶圖像UI1包括第一用戶臉部圖像FI及/或第一用戶眼部圖像EI。臉部圖像是指用戶圖像中的臉部的圖像。而眼部圖像是指用戶圖像中的眼睛部分的圖像。例如,虹膜圖像。在其他實施例中,第一用戶圖像UI1也可能包括嘴巴、鼻子或人體其他部位的圖像。In an embodiment, the first user image UI1 includes a first user face image FI and/or a first user eye image EI. The face image refers to the image of the face in the user image. The eye image refers to the image of the eye part in the user's image. For example, an iris image. In other embodiments, the first user image UI1 may also include images of mouth, nose or other parts of the human body.
請參照圖3B,第一圖像可以是第一裝置圖像DI1。第一裝置圖像DI1可包括第一相機圖像、第一行動電話圖像、第一平板電腦圖像及/或第一筆記電腦圖像。也就是,相機、手機、平板電腦或筆記型電腦的圖像。Referring to FIG. 3B, the first image may be the first device image DI1. The first device image DI1 may include a first camera image, a first mobile phone image, a first tablet image and/or a first laptop image. That is, images from a camera, phone, tablet or laptop.
請參照圖3C,第一圖像可以是手勢圖像GI1。手勢圖像GI1是特殊手勢的圖像。手勢圖像GI1可包括第一按壓手勢圖像、第一拍照手勢圖像或第一自拍手勢圖像。例如,食指按壓手勢、握手機手勢或握平板手勢。Referring to FIG. 3C, the first image may be the gesture image GI1. The gesture image GI1 is an image of a special gesture. The gesture image GI1 may include a first pressing gesture image, a first photographing gesture image, or a first selfie gesture image. For example, the index finger pressing gesture, the mobile phone holding gesture, or the tablet holding gesture.
請參照圖3D,第一圖像可以是第二用戶圖像UI2。第二用戶圖像UI2是不同於第一用戶圖像(例如,圖3A的第一用戶圖像UI1)的人物的圖像。相似地,第二用戶圖像UI2也可能包括諸如臉部、眼部或其他人體部位的圖像。Referring to FIG. 3D, the first image may be the second user image UI2. The second user image UI2 is an image of a person different from the first user image (eg, the first user image UI1 of FIG. 3A ). Similarly, the second user image UI2 may also include images such as face, eyes or other human body parts.
然而,第一圖像仍有其他變化的可能。However, other variations of the first image are still possible.
在一實施例中,圖像的辨識可基於物件偵測技術。例如,透過神經網路的演算法(例如,YOLO(You only look once)、基於區域的卷積神經網路(Region Based Convolutional Neural Networks,R-CNN)、或快速R-CNN(Fast CNN))或是基於特徵匹配的演算法(例如,方向梯度直方圖(Histogram of Oriented Gradient,HOG)、尺度不變特徵轉換(Scale-Invariant Feature Transform,SIFT)、Harr、或加速穩健特徵(Speeded Up Robust Features,SURF)的特徵比對)實現物件偵測。In one embodiment, image recognition may be based on object detection technology. For example, through neural network algorithms (for example, YOLO (You only look once), Region Based Convolutional Neural Networks (R-CNN), or Fast R-CNN (Fast CNN)) Or algorithms based on feature matching (such as Histogram of Oriented Gradient (HOG), Scale-Invariant Feature Transform (SIFT), Harr, or Speeded Up Robust Features , SURF) feature comparison) to achieve object detection.
請參照圖2,處理單元14判斷第一圖像,是否符合註冊圖像(步驟S230)。具體而言,註冊圖像是預先儲存在記憶單元13且/或通過認證的用戶、手勢及/或裝置的圖像。處理單元14可利用前述物件偵測技術的偵測結果直接判斷第一圖像是否為註冊圖像。例如,註冊圖像為用戶A的臉部圖像,物件偵測結果的物件類型為狗頭圖像,故不符合臉部圖像。或者,處理單元14可利用特徵比對方式判斷第一圖像與註冊圖像之間的相似性,並依據相似性判斷第一圖像是否符合註冊圖像。例如,相似性高於門檻值(例如,75、85或90%)者符合註冊圖像,但相似性低於門檻者不符合註冊圖像。Referring to FIG. 2 , the
在一實施例中,註冊圖像包括註冊用戶圖像。也就是,通過認證的用戶的圖像。在比對註冊圖像前,可先記錄註冊用戶的影像特徵,以供後續比對。例如,圖3A所示的第一用戶圖像UI1的人物的圖像為註冊用戶圖像,但圖3D所示的第二用戶圖像UI2的人物的圖像不為註冊用戶圖像。In one embodiment, the registration image includes a registered user image. That is, the image of the authenticated user. Before comparing registered images, the image characteristics of registered users can be recorded for subsequent comparison. For example, the image of the person in the first user image UI1 shown in FIG. 3A is a registered user image, but the image of the person in the second user image UI2 shown in FIG. 3D is not a registered user image.
在一實施例中,註冊用戶圖像包括註冊用戶臉部圖像或註冊用戶眼部圖像。也就是,通過認證的用戶的臉部或眼部的圖像。註冊用戶臉部圖像或註冊用戶眼部圖像可自註冊用戶圖像裁切出來。或者,感測單元12的偵測範圍可僅針對用戶的臉部或眼部,從而直接得出註冊用戶臉部圖像或註冊用戶眼部圖像。In one embodiment, the registered user image includes a registered user face image or a registered user eye image. That is, an image of the authenticated user's face or eyes. The registered user's face image or the registered user's eye image can be cropped from the registered user's image. Alternatively, the detection range of the
在一實施例中,註冊圖像包括註冊裝置圖像。也就是,目標裝置的圖像。在比對註冊圖像前,可先記錄目標裝置的影像特徵,以供後續比對。In one embodiment, the registration image includes a registration device image. That is, an image of the target device. Before comparing the registered images, the image characteristics of the target device can be recorded for subsequent comparison.
在一實施例中,註冊圖像包括註冊手勢圖像。也就是,特定手勢的圖像。在比對註冊圖像前,可先記錄特定手勢的影像特徵,以供後續比對。In one embodiment, the registration image includes a registration gesture image. that is, images of specific gestures. Before comparing registered images, image features of specific gestures can be recorded for subsequent comparison.
處理單元14依據第一圖像的判斷結果,遮蔽原始畫面(步驟S240)。判斷結果為第一圖像符合註冊圖像或第一圖像不符合註冊圖像中的一者。The
在一實施例中,若第一圖像符合註冊圖像,則螢幕單元11維持顯示原始畫面且未受其他畫面遮蔽。而若第一圖像不符合註冊圖像,則處理單元14藉由螢幕單元11顯示提示畫面、模糊畫面、調暗畫面或其組合,以遮蔽至少部分的原始畫面。In one embodiment, if the first image matches the registered image, the
舉例而言,圖4A及圖4B是依據本發明一實施例的畫面遮蔽的示意圖。請參照圖4A,原始畫面是影片播放。請參照圖4B,假設圖3D所示的第二用戶圖像UI2的人物的圖像不為註冊用戶圖像,且第一圖像為第二用戶圖像UI2,則顯示模糊畫面以遮蔽影片播放。For example, FIG. 4A and FIG. 4B are schematic diagrams of screen masking according to an embodiment of the present invention. Please refer to Figure 4A, the original picture is a video playback. Referring to FIG. 4B , assuming that the image of the person in the second user image UI2 shown in FIG. 3D is not a registered user image, and the first image is the second user image UI2 , a blurred image is displayed to block the video playback. .
此外,提示畫面還可額外提示文字或圖案訊息。在一實施例中,提示畫面包括提示資安畫面、提示行程畫面、提示距離畫面、提示姿勢畫面或提示休息畫面。例如,圖4B所示「眼睛休息時間」的休息提示訊息。須說明的是,畫面中的訊息仍可依據應用者的實際需求而自行變更,本發明實施例不加以限制。In addition, the prompt screen can also prompt additional text or pattern messages. In one embodiment, the prompt screen includes an information security prompt screen, a journey prompt screen, a distance prompt screen, a posture prompt screen, or a rest prompt screen. For example, the rest prompt message of "eye rest time" shown in Figure 4B. It should be noted that the information on the screen can still be changed according to the actual needs of the user, which is not limited by the embodiments of the present invention.
圖5是依據本發明一實施例的螢幕單元管理方法的流程圖。請參照圖5,處理單元14可辨識偵測資料中的第二圖像(步驟S510)。也就是,辨識出圖2所辨識出的第一圖像的其他圖像。FIG. 5 is a flow chart of a screen unit management method according to an embodiment of the present invention. Referring to FIG. 5 , the
圖6A至圖6C是依據本發明一實施例的第一圖像及第二圖像的示意圖。請參照圖6A,第一圖像可以是第一用戶圖像UI1。而第二圖像可以是第二用戶圖像UI2。6A to 6C are schematic diagrams of a first image and a second image according to an embodiment of the present invention. Referring to FIG. 6A, the first image may be the first user image UI1. And the second image may be the second user image UI2.
在一實施例中,第二用戶圖像UI2也可包括第二用戶臉部圖像、第二用戶眼部圖像及/或第二用戶其他部位的圖像。In an embodiment, the second user image UI2 may also include a second user's face image, a second user's eye image, and/or images of other parts of the second user.
請參照圖6B,第二圖像可以是第二裝置圖像DI2。相似地,第二裝置圖像DI2可以是第二相機圖像、第二行動電話圖像、第二平板電腦圖像及/或第二筆記電腦圖像。如圖3所示,用戶圖像UI4手持手機並拍攝的圖像。Referring to FIG. 6B, the second image may be a second device image DI2. Similarly, the second device image DI2 may be a second camera image, a second mobile phone image, a second tablet image and/or a second laptop image. As shown in Figure 3, the user image UI4 holds the mobile phone and takes the image.
請參照圖6C,第二圖像可以是手勢圖像GI2。手勢圖像GI1是特殊手勢的圖像。手勢圖像GI2可包括第二按壓手勢圖像、第二拍照手勢圖像或第二自拍手勢圖像。如圖3所示,用戶圖像UI4手持手機並擺出食指按壓手勢。Referring to FIG. 6C, the second image may be the gesture image GI2. The gesture image GI1 is an image of a special gesture. The gesture image GI2 may include a second pressing gesture image, a second photographing gesture image, or a second selfie gesture image. As shown in Figure 3, the user image UI4 holds the mobile phone and makes a pressing gesture with the index finger.
處理單元14判斷第二圖像,是否符合註冊圖像(步驟S520)。註冊圖像的說明可參酌圖2的步驟S230的說明,於此不再贅述。The
處理單元14依據第二圖像的判斷結果,遮蔽原始畫面(步驟S530)。判斷結果為第二圖像符合註冊圖像或第二圖像不符合註冊圖像中的一者。The
在一實施例中,當第二圖像符合註冊圖像時,處理單元14可藉由螢幕單元11顯示提示畫面、模糊畫面、調暗畫面或其組合,以遮蔽原始畫面的全部或部分。例如,若當前偵測影像同時包括註冊用戶與其他用戶、包括註冊用戶和手機圖像、或包括註冊用戶和手指按壓圖像,則顯示遮罩,以遮蔽原始畫面。In one embodiment, when the second image matches the registered image, the
在一實施例中,當第一圖像不符合註冊圖像時,處理單元14可計算第一圖像的第一區域面積。第一區域面積是第一圖像的定界框(bounding box)或感興趣區域(Region of Interest,ROI)的面積。例如,臉部圖像的面積。面積的度量可以是像素數量或長度。In an embodiment, when the first image does not conform to the registered image, the
在一實施例中,當第二圖像符合註冊圖像時,處理單元14可計算第二圖像的第二區域面積。第二區域面積是第二圖像的定界框或感興趣區域的面積。In an embodiment, when the second image matches the registered image, the
以圖6A為例,第一區域面積是第一用戶圖像UI1的定界框B1的面積,且第二區域面積是第二用戶圖像UI2的定界框B2的面積。Taking FIG. 6A as an example, the first area area is the area of the bounding box B1 of the first user image UI1, and the second area area is the area of the bounding box B2 of the second user image UI2.
面積比較可用於遮蔽決策。圖7是依據本發明一實施例的螢幕單元管理方法的流程圖。請參照圖7,處理單元14可比較第一區域面積與第二區域面積(步驟S710),並依據第一區域面積與第二區域面積的比較結果,遮蔽原始畫面。當第二區域面積小於第一區域面積的預定比例時,處理單元14可透過螢幕單元11遮蔽原始畫面(步驟S720)。預定比例的範圍為75%~85%。例如,80%。然而,預定比例仍有其他變化的可能。Area comparison can be used for masking decisions. FIG. 7 is a flow chart of a screen unit management method according to an embodiment of the present invention. Referring to FIG. 7 , the
當第二區域面積未小於第一區域面積的預定比例時,處理單元14可透過螢幕單元11遮蔽原始畫面或關閉螢幕單元11 (步驟S730)。When the area of the second area is not smaller than the predetermined ratio of the area of the first area, the
除了用戶及物件比對,還有其他遮蔽決策。圖8是依據本發明一實施例的螢幕單元管理方法的流程圖。請參照圖8,處理單元14可判斷目前時間,是否符合遮蔽時段(步驟S810)。遮蔽時段可以是12:00PM~01:00PM。也就是,中午12點至下午一點的午餐或休息時間。在其他實施例中,遮蔽時段可以是06:00PM~10:00PM或其他時段。In addition to user and object comparisons, there are other occlusion decisions. FIG. 8 is a flow chart of a screen unit management method according to an embodiment of the present invention. Referring to FIG. 8 , the
當目前時間符合遮蔽時段時,處理單元14可透過螢幕單元11遮蔽原始畫面。也就是,若目前時間在遮蔽時段內,則遮蔽畫面。When the current time matches the blocking period, the
在一實施例中,在判斷遮蔽時段之前,可先判斷第一圖像是否符合註冊圖像。當第一圖像符合註冊圖像時,才進行後續遮蔽時段的判斷。當第一圖像不符合註冊圖像時,持續偵測是否有註冊圖像出現。In one embodiment, before determining the masking period, it may be determined whether the first image matches the registered image. When the first image matches the registered image, the subsequent masking period is determined. When the first image does not match the registered image, it is continuously detected whether a registered image appears.
圖9是依據本發明一實施例的螢幕單元管理方法的流程圖。請參照圖9,處理單元14可計算第一圖像對應的第一距離。第一圖像對應於第一物體(例如,臉部、裝置或手),且第一距離為第一物體與螢幕單元11/感測單元12之間的距離。而本實施例有距離偵測的需求,因此偵測資料可以是近接感測器或紅外線相機的偵測資料。處理單元14可判斷第一距離是否大於第一距離上限、或第一距離是否小於第一距離下限(步驟S910)。例如,第一距離上限的範圍為140公分~160公分。第一距離下限的範圍為40公分~50公分。然而,第一距離上限及第一距離下限仍有其他變化的可能。當第一距離大於第一距離上限及/或第一距離小於第一距離下限時,處理單元14可透過螢幕單元11遮蔽原始畫面(步驟S920)。FIG. 9 is a flow chart of a screen unit management method according to an embodiment of the present invention. Referring to FIG. 9 , the
舉例而言,圖10A及圖10B是依據本發明一實施例的觀看距離的示意圖。請參照圖10A,假設第一物體是用戶U,電子裝置10與用戶U之間有距離D1。距離D1為200公分且大於160公分的第一距離上限。請參照圖10A,假設電子裝置10與用戶U之間有距離D2。距離D2為30公分且小於40公分的第一距離下限。For example, FIG. 10A and FIG. 10B are schematic diagrams of viewing distances according to an embodiment of the present invention. Please refer to FIG. 10A , assuming that the first object is the user U, and there is a distance D1 between the
另一方面,當第一距離未大於第一距離上限且第一距離未小於第一距離下限時,可維持顯示原始畫面但不遮蔽原始畫面(步驟S930)。On the other hand, when the first distance is not greater than the first distance upper limit and the first distance is not less than the first distance lower limit, the original picture can be maintained to be displayed but the original picture is not blocked (step S930).
圖11是依據本發明一實施例的螢幕單元管理方法的流程圖。請參照圖11,第一圖像包括一第一眼部圖像,處理單元14可計算第一眼部圖像相對於參考水平線的第一寬度。FIG. 11 is a flow chart of a screen unit management method according to an embodiment of the present invention. Referring to FIG. 11 , the first image includes a first eye image, and the
舉例而言,圖12是依據本發明一實施例的觀看高度的示意圖。請參照圖12,螢幕單元11具有螢幕長度L(即,圖面的橫向長度)與螢幕寬度W(即,圖面的縱向長度)。參考水平線為螢幕單元的中心水平線。例如,中心水平線為螢幕寬度W的二分之一的第一寬度下限DL。眼部圖像至中心水平線的距離為第一寬度W1。For example, FIG. 12 is a schematic diagram of viewing height according to an embodiment of the present invention. Referring to FIG. 12 , the
而本實施例有高度偵測的需求,因此偵測資料可以是近紅外線相機、或彩色相機的偵測資料。This embodiment has high detection requirements, so the detection data may be detection data from a near-infrared camera or a color camera.
請參照圖11,處理單元14可判斷第一寬度是否大於第一寬度上限、或第一寬度是否小於第一寬度下限(步驟S1110)。以圖12為例,第一寬度上限UL為3/4W(也就是,螢幕寬度W的四分之三),第一距離下限DL為1/2W(也就是,螢幕寬度W的二分之一)。然而,第一寬度上限及第一寬度下限仍有其他變化的可能。當第一寬度大於第一寬度上限及/或第一寬度小於第一寬度下限時,處理單元14可透過螢幕單元11遮蔽原始畫面(步驟S1120)。Referring to FIG. 11 , the
另一方面,當第一寬度未大於第一寬度上限且第一寬度未小於第一寬度下限時,可維持顯示原始畫面但不遮蔽原始畫面(步驟S1130)。On the other hand, when the first width is not greater than the first upper limit of width and the first width is not less than the first lower limit of width, the original picture can be maintained to be displayed without blocking the original picture (step S1130).
在一實施例中,當第一寬度未大於第一寬度上限且第一寬度未小於第一寬度下限及/或第一距離未大於第一距離上限且第一距離未小於第一距離下限時,處理單元14可進一步判斷第一圖像及/或第二圖像是否符合註冊圖像,並據以遮蔽原始畫面。In one embodiment, when the first width is not greater than the first width upper limit and the first width is not less than the first width lower limit and/or the first distance is not greater than the first distance upper limit and the first distance is not less than the first distance lower limit, The
圖13是依據本發明一實施例的螢幕單元管理方法的流程圖。請參照圖13,當第一圖像符合註冊圖像時,處理單元14可計算累計時間(步驟S1310)。具體而言,當偵測到註冊圖像時,處理單元14可將當前時間記錄為初始時間。接著,處理單元14可依據這初始時間計算累計時間。處理單元14可判斷這累計時間是否大於時間上限。時間上限為20分鐘或25分鐘。20分鐘有助於睫狀肌放鬆,而25分鐘符合番茄鐘工作法。也就是,判斷用戶觀看時間是否超時。然而,時間上限仍有其他變化的可能。FIG. 13 is a flow chart of a screen unit management method according to an embodiment of the present invention. Referring to FIG. 13 , when the first image matches the registered image, the
當累計時間大於時間上限時,處理單元14可透過螢幕單元11可遮蔽原始畫面(步驟S1320)。也就是,觀看超時,故需要建議休息。另一方面,當累計時間未大於時間上限時,可維持顯示原始畫面但不遮蔽原始畫面。When the accumulated time is greater than the upper limit of time, the
圖14是依據本發明一實施例的螢幕單元管理方法的流程圖。處理單元14可取得近接感測器、紅外線相機及彩色相機中的至少二者的原始資料。處理單元14可依據近接感測器、紅外線相機及該彩色相機的原始資料的資料大小挑選一者,並據以產生偵測資料。資料大小的最小者具有受挑選的最大優先權,且資料大小的最大者具有受挑選的最小優先權。也就是,資料量越少的原始資料可被選擇作為偵測資料。或是,偵測資料包括近接感測器、紅外線相機或彩色相機的偵測資料中,資料大小的最小者。一般而言,偵測資料的資料大小的排序為近接感測器<紅外線相機<彩色相機。因此,在針對特定偵測需求而存在複數感測單元12的情況下,受選的優先排序為近接感測器>紅外線相機>彩色相機。FIG. 14 is a flow chart of a screen unit management method according to an embodiment of the present invention. The
例如,當複數個感測單元12可用於特定偵測需求時,受挑選的優先權如下:
若用於偵測用戶與感測單元12之間的距離,則近接感測器>紅外線相機;
若用於偵測面部訊息,則紅外線相機>彩色相機;
若用於偵測使用者是否存在,則近接感測器>紅外線相機>彩色相機。
For example, when a plurality of
須說明的是,前述實施例還需要依據所具備的感測單元12的類型判斷是否使用特定遮蔽決策。例如,未有近接感測器,則禁能距離相關的遮蔽決策。例如,未有彩色相機,則禁能觀看高度相關的遮蔽決策。此外,偵測不同遮蔽決策,還可提供不同遮蔽畫面。例如,觀看時間的遮蔽決策是提供提示休息畫面,而未有註冊用戶是提供提示資安畫面。然而,所提示的畫面仍可依據實際需求而自行變更。It should be noted that the aforementioned embodiments also need to determine whether to use a specific shielding decision based on the type of the
本發明實施例更提供一種非暫態電腦可讀取儲存媒體(例如,硬碟、光碟、快閃記憶體、固態硬碟(Solid State Disk,SSD)等儲存媒體),並用以儲存程式碼。電子裝置100、處理單元14或其他處理器可載入程式碼,並據以執行本發明實施例的一個或更多個螢幕單元管理方法的相應流程。這些流程可參酌上文說明,且於此不再贅述。Embodiments of the present invention further provide a non-transitory computer-readable storage medium (for example, a storage medium such as a hard disk, an optical disk, a flash memory, a solid state disk (SSD), etc.) for storing program codes. The electronic device 100, the
綜上所述,本發明實施例的螢幕單元管理方法、電子裝置及非暫態電腦可讀取儲存媒體,提供以下功效及優點:In summary, the screen unit management method, electronic device and non-transitory computer-readable storage medium according to embodiments of the present invention provide the following functions and advantages:
自訂時間:本發明實施例能依據用戶對電子裝置所設定的自定義時間來顯示畫面的不同遮罩機制,並搭配螢幕提示視窗,從而提醒用戶該進行下一階段事項。Customized time: Embodiments of the present invention can display different masking mechanisms of the screen according to the customized time set by the user on the electronic device, and match the screen prompt window to remind the user that it is time to proceed to the next stage.
距離:本發明實施例能依據用戶與電子裝置螢幕的相對距離而引發螢幕顯示畫面的不同遮罩機制,用戶須處於一定距離範圍之內才能解除畫面遮罩,以主動方式讓用戶與電子裝置螢幕維持適當使用距離。Distance: Embodiments of the present invention can trigger different masking mechanisms of the screen display screen based on the relative distance between the user and the electronic device screen. The user must be within a certain distance range to release the screen masking, allowing the user to interact with the electronic device screen in an active manner. Maintain an appropriate usage distance.
高度:本發明實施例能依據用戶與電子裝置螢幕的相對高度而引發螢幕顯示畫面的不同遮罩機制,用戶須處於一定高度範圍之內才能解除畫面遮罩,以主動方式讓用戶維持正確姿勢與電子裝置螢幕維持適當使用高度。Height: Embodiments of the present invention can trigger different masking mechanisms of the screen display based on the relative height of the user and the electronic device screen. The user must be within a certain height range to unblock the screen, allowing the user to maintain correct posture and posture in an active manner. Keep electronic device screens at an appropriate height for use.
註冊用戶:本發明實施例能註冊與記錄用戶特徵,能依據用戶與電子裝置螢幕的不同使用狀態而引發螢幕顯示畫面的不同遮罩機制,避免非用戶使用電腦時的窺視/資安問題。Registered users: Embodiments of the present invention can register and record user characteristics, trigger different masking mechanisms for the screen display according to the different usage states of the user and the electronic device screen, and avoid peeping/information security issues when non-users use the computer.
累計時間:本發明實施例能依據用戶與電子裝置螢幕的互動時間而引發螢幕顯示畫面的不同遮罩機制,並搭配螢幕提示視窗,從而提醒用戶需做休息或是需看遠方以放鬆睫狀肌。Accumulated time: The embodiment of the present invention can trigger different masking mechanisms of the screen display according to the interaction time between the user and the electronic device screen, and match the screen prompt window to remind the user to take a rest or to look far away to relax the ciliary muscles. .
雖然本發明已以實施例揭露如上,然其並非用以限定本發明,任何所屬技術領域中具有通常知識者,在不脫離本發明的精神和範圍內,當可作些許的更動與潤飾,故本發明的保護範圍當視後附的申請專利範圍所界定者為準。Although the present invention has been disclosed above through embodiments, they are not intended to limit the present invention. Anyone with ordinary knowledge in the technical field may make some modifications and modifications without departing from the spirit and scope of the present invention. Therefore, The protection scope of the present invention shall be determined by the appended patent application scope.
10:電子裝置 11:螢幕單元 12:感測單元 13:記憶單元 14:處理單元 15:第一機體 16:第二機體 S210~S240、S510~S530、S710~S730、S810~S820、S910~S930、S1110~S1130、S1310~S1320、S1310~S1420:步驟 UI1:第一用戶圖像 FI:第一用戶臉部圖像 EI:第一用戶眼部圖像 DI1:第一裝置圖像 GI1:手勢圖像 UI2:第二用戶圖像 B1、B2:定界框 UI4:用戶圖像 DI2:第二裝置圖像 GI2:第二手勢圖像 D1、D2:距離 L:螢幕長度 W:螢幕寬度 W:第一寬度 UL:第一寬度上限 DL:第一寬度下限 10: Electronic devices 11:Screen unit 12: Sensing unit 13: Memory unit 14: Processing unit 15:First body 16:Second body S210~S240, S510~S530, S710~S730, S810~S820, S910~S930, S1110~S1130, S1310~S1320, S1310~S1420: Steps UI1: first user image FI: first user face image EI: First user eye image DI1: First device image GI1: Gesture image UI2: Second user image B1, B2: bounding box UI4: User Image DI2: Second device image GI2: Second gesture image D1, D2: distance L: screen length W: screen width W: first width UL: first width upper limit DL: first width lower limit
圖1A是依據本發明一實施例的電子裝置的元件方塊圖。 圖1B是依據本發明一實施例的電子裝置的示意圖。 圖2是依據本發明一實施例的螢幕單元管理方法的流程圖。 圖3A至圖3D是依據本發明一實施例的第一圖像的示意圖。 圖4A及圖4B是依據本發明一實施例的畫面遮蔽的示意圖。 圖5是依據本發明一實施例的螢幕單元管理方法的流程圖。 圖6A至圖6C是依據本發明一實施例的第一圖像及第二圖像的示意圖。 圖7是依據本發明一實施例的螢幕單元管理方法的流程圖。 圖8是依據本發明一實施例的螢幕單元管理方法的流程圖。 圖9是依據本發明一實施例的螢幕單元管理方法的流程圖。 圖10A及圖10B是依據本發明一實施例的觀看距離的示意圖。 圖11是依據本發明一實施例的螢幕單元管理方法的流程圖。 圖12是依據本發明一實施例的觀看高度的示意圖。 圖13是依據本發明一實施例的螢幕單元管理方法的流程圖。 圖14是依據本發明一實施例的螢幕單元管理方法的流程圖。 FIG. 1A is a block diagram of an electronic device according to an embodiment of the invention. FIG. 1B is a schematic diagram of an electronic device according to an embodiment of the present invention. FIG. 2 is a flow chart of a screen unit management method according to an embodiment of the present invention. 3A to 3D are schematic diagrams of a first image according to an embodiment of the present invention. 4A and 4B are schematic diagrams of screen masking according to an embodiment of the present invention. FIG. 5 is a flow chart of a screen unit management method according to an embodiment of the present invention. 6A to 6C are schematic diagrams of a first image and a second image according to an embodiment of the present invention. FIG. 7 is a flow chart of a screen unit management method according to an embodiment of the present invention. FIG. 8 is a flow chart of a screen unit management method according to an embodiment of the present invention. FIG. 9 is a flow chart of a screen unit management method according to an embodiment of the present invention. 10A and 10B are schematic diagrams of viewing distances according to an embodiment of the present invention. FIG. 11 is a flow chart of a screen unit management method according to an embodiment of the present invention. FIG. 12 is a schematic diagram of viewing height according to an embodiment of the present invention. FIG. 13 is a flow chart of a screen unit management method according to an embodiment of the present invention. FIG. 14 is a flow chart of a screen unit management method according to an embodiment of the present invention.
S210~S240:步驟 S210~S240: steps
Claims (23)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US202163241107P | 2021-09-07 | 2021-09-07 | |
US63/241,107 | 2021-09-07 |
Publications (2)
Publication Number | Publication Date |
---|---|
TW202311910A TW202311910A (en) | 2023-03-16 |
TWI824683B true TWI824683B (en) | 2023-12-01 |
Family
ID=86690547
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW111132289A TWI824683B (en) | 2021-09-07 | 2022-08-26 | Screen unit management method, electronic apparatus, and non-transitory computer-readable storage medium |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWI824683B (en) |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105117628A (en) * | 2015-07-30 | 2015-12-02 | 广东欧珀移动通信有限公司 | File display control method, apparatus and corresponding mobile device in terminal |
TW201545713A (en) * | 2014-06-09 | 2015-12-16 | Li Zhong Wu | Vision Protection Method and System Thereof |
US20160193104A1 (en) * | 2013-08-22 | 2016-07-07 | Beijing Zhigu Rui Tuo Tech Co., Ltd | Eyesight-protection imaging apparatus and eyesight-protection imaging method |
CN109963195A (en) * | 2019-04-01 | 2019-07-02 | 深圳聪明目智能科技有限公司 | A kind of sight protectio method and device thereof applied to television set |
CN110600142A (en) * | 2019-11-18 | 2019-12-20 | 四川骏逸富顿科技有限公司 | Identity authentication system for electronic prescription and working method thereof |
CN111382666A (en) * | 2018-12-31 | 2020-07-07 | 三星电子株式会社 | Apparatus and method with user authentication |
CN112364321A (en) * | 2020-11-05 | 2021-02-12 | 巢湖学院 | Cloud desktop-based monitoring method for mobile learning smart phone |
-
2022
- 2022-08-26 TW TW111132289A patent/TWI824683B/en active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160193104A1 (en) * | 2013-08-22 | 2016-07-07 | Beijing Zhigu Rui Tuo Tech Co., Ltd | Eyesight-protection imaging apparatus and eyesight-protection imaging method |
TW201545713A (en) * | 2014-06-09 | 2015-12-16 | Li Zhong Wu | Vision Protection Method and System Thereof |
CN105117628A (en) * | 2015-07-30 | 2015-12-02 | 广东欧珀移动通信有限公司 | File display control method, apparatus and corresponding mobile device in terminal |
CN111382666A (en) * | 2018-12-31 | 2020-07-07 | 三星电子株式会社 | Apparatus and method with user authentication |
CN109963195A (en) * | 2019-04-01 | 2019-07-02 | 深圳聪明目智能科技有限公司 | A kind of sight protectio method and device thereof applied to television set |
CN110600142A (en) * | 2019-11-18 | 2019-12-20 | 四川骏逸富顿科技有限公司 | Identity authentication system for electronic prescription and working method thereof |
CN112364321A (en) * | 2020-11-05 | 2021-02-12 | 巢湖学院 | Cloud desktop-based monitoring method for mobile learning smart phone |
Also Published As
Publication number | Publication date |
---|---|
TW202311910A (en) | 2023-03-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11521423B2 (en) | Occlusion detection for facial recognition processes | |
CN110889320B (en) | Periocular face recognition switching | |
US11367305B2 (en) | Obstruction detection during facial recognition processes | |
WO2020062969A1 (en) | Action recognition method and device, and driver state analysis method and device | |
WO2016180224A1 (en) | Method and device for processing image of person | |
CN102096805B (en) | Apparatus and method for registering plurality of facial images for face recognition | |
TW201339987A (en) | Electronic device and method for preventing screen peeking | |
WO2019148968A1 (en) | Mobile terminal, facial unlocking method, and related product | |
CA2773865A1 (en) | Display device with image capture and analysis module | |
CN108090405A (en) | A kind of face identification method and terminal | |
US20140313230A1 (en) | Transformation of image data based on user position | |
US20180376121A1 (en) | Method and electronic device for displaying panoramic image | |
KR20120139100A (en) | Apparatus and method for security management using face recognition | |
CN104867112B (en) | Photo processing method and device | |
CN107948399A (en) | Eye protection method and device for mobile terminal, mobile terminal and storage medium | |
CN111259757A (en) | Image-based living body identification method, device and equipment | |
CN108093165A (en) | A kind of image processing method and device | |
TWI824683B (en) | Screen unit management method, electronic apparatus, and non-transitory computer-readable storage medium | |
US20170112381A1 (en) | Heart rate sensing using camera-based handheld device | |
US20200104471A1 (en) | User authentication using variant illumination | |
US11810401B1 (en) | Methods and systems for enhancing user liveness detection | |
CN116361761A (en) | A kind of information shielding method, information shielding device and electronic equipment | |
TW201915661A (en) | Gaze detection, identification and control method | |
TW201702938A (en) | Eye state detecting method and eye state detecting system | |
CN113749614B (en) | Skin detection method and apparatus |