[go: up one dir, main page]

CN110191170B - Live photo broadcasting system with face recognition function and method thereof - Google Patents

Live photo broadcasting system with face recognition function and method thereof Download PDF

Info

Publication number
CN110191170B
CN110191170B CN201910441236.1A CN201910441236A CN110191170B CN 110191170 B CN110191170 B CN 110191170B CN 201910441236 A CN201910441236 A CN 201910441236A CN 110191170 B CN110191170 B CN 110191170B
Authority
CN
China
Prior art keywords
photo
face recognition
server
information
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910441236.1A
Other languages
Chinese (zh)
Other versions
CN110191170A (en
Inventor
宋端磊
钱龙
林吉炫
苏聪厚
田永胜
接志蒙
路峰
袁成彬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanxi Gongzhi Technology Co ltd
Original Assignee
Shanxi Gongzhi Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanxi Gongzhi Technology Co ltd filed Critical Shanxi Gongzhi Technology Co ltd
Priority to CN201910441236.1A priority Critical patent/CN110191170B/en
Publication of CN110191170A publication Critical patent/CN110191170A/en
Application granted granted Critical
Publication of CN110191170B publication Critical patent/CN110191170B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53—Querying
    • G06F16/538—Presentation of query results
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Library & Information Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Studio Devices (AREA)

Abstract

The invention discloses a live photo broadcasting system with face recognition and a method thereof. The system comprises a server, a cloud storage system, a playing terminal and a face recognition system; the server is used for sending the first photo to the cloud storage system for storage; the face recognition system is used for inquiring the face recognition characteristic information from the first database and sending the face recognition characteristic information to the playing terminal; the face recognition system is used for responding to a face recognition processing request sent by the server and returning the first photo and the second face recognition characteristic to the server; the playing terminal is used for uploading the second photo to the server, inquiring an access request of the first photo with the same face recognition characteristic as the second photo, and displaying the face recognition characteristic, the face image and/or the first photo according to the inquiry result. The invention realizes instant uploading and instant browsing of massive photos, solves the problems caused by high concurrency, high access and high downloading, and realizes instant face recognition of the photos, thereby realizing live broadcasting of the photos.

Description

Live photo broadcasting system with face recognition function and method thereof
Technical Field
The invention relates to a live photo broadcasting system with face recognition and a method thereof.
Background
With the popularization of cameras, the demand for immediacy of photo acquisition is becoming strong. For example, at a news event scene, it is necessary to quickly transmit a picture taken by a camera to a colleague in an office to quickly bring up news. For example, some large well-known brand companies have already prepared public customs drafts, but photos must be taken only after a photographer has taken a picture and pulled out the card to be exported and repaired, the active photos cannot be processed in time, a user cannot receive satisfactory photos in time, and once the photographer deletes the photos without backup, the photos cannot be retrieved forever.
At present, in order to realize sharing of photos taken in meetings and activities, mutual manual sending is often adopted, for example, a photographer forwards the photos to others one by one through WeChat and microblog, and the manual sending mode is time-consuming and labor-consuming.
Cloud computing (cloud computing) is an internet-based mode of addition, use, and delivery of related services, typically involving the provision of dynamically scalable and often virtualized resources over the internet. In the related technology, the cloud photo album is used by vast users, and the users can store the photos or the photos in the cloud photo album and obtain the photos in the cloud photo album when needing to watch and use the cloud photo album.
However, in the using process of the cloud photo album, a user can only directly upload a photo or a photo to the cloud photo album through a computer, and after uploading, the user can also check the photo by himself and cannot share and watch the photo, particularly, when a large number of photos are shot in a conference scene, the problem that a cloud storage system is easy to collapse due to the fact that a network system is easy to upload the large number of photos is solved, and real-time uploading and downloading of the large number of photos cannot be really achieved.
Disclosure of Invention
Aiming at the defects in the prior art, the invention provides a live photo broadcasting system with face recognition and a method thereof. The photo live broadcasting system and the method thereof realize instant uploading and downloading of massive photos and instant browsing and sharing of millions of users, solve the problems of low photo uploading and downloading speed and breakdown of a network and a cloud storage system caused by high concurrency, high access and high downloading, realize instant face recognition of the photos, and greatly reduce the waiting time for face recognition, thereby realizing the photo live broadcasting.
According to one aspect of the invention, a live photo broadcasting system with face recognition is provided, and the system comprises a server, a cloud storage system, a playing terminal and a face recognition system;
the server is used for sending the first photo to the cloud storage system for storage and receiving first photo storage address information returned by the cloud storage system, and the server carries out second association on the face recognition characteristic of the first photo, live broadcast room information and the first photo storage address information and stores the second photo storage address information to the first database; the second photo is sent to a face recognition system for face recognition in response to the access request of the playing terminal; inquiring the storage address information of the first photo from the first database according to the second association and the face recognition characteristics of the second photo, and sending the inquiry result to the playing terminal;
the face recognition system is used for responding to a face recognition processing request sent by the server, accessing a first photo storage address and acquiring a first photo, performing face recognition processing on the first photo and returning the face recognition characteristics of the first photo to the server, and performing face recognition processing on the second photo and returning the face recognition characteristics of the second photo to the server;
the playing terminal is used for uploading the second photo to the server and inquiring an access request of the first photo, and displaying the face recognition feature, the face image, the first photo and/or a first photo collection according to the inquiry result, preferably, the first photo collection is displayed in the form of a picture album, a splicing picture, a short video or a dynamic picture, and the picture is a thumbnail, a big picture, a middle picture or an original picture;
the first photo and the second photo have the same or matched face recognition characteristics;
preferably, the system further comprises a camera and an intelligent image transmission device, wherein the intelligent image transmission device is used for selecting the live broadcast room, receiving a first photo shot by the camera, performing first association on the first photo and the live broadcast room information, and uploading the first photo and the live broadcast room information to the server.
Wherein the face recognition system comprises:
the second database is used for storing the photos and the face recognition characteristic information thereof;
the face information processing module is used for receiving the face recognition characteristic information sent by the face recognition module, inquiring and/or updating the face recognition characteristic information in the second database, judging whether a person in the photo has a new person, if so, storing the photo in the second database, and if not, not storing the photo; the face information processing result is returned to the face recognition module and/or the server;
and the face recognition module is used for carrying out face recognition on the photo and sending the face recognition characteristic information to the face information processing module and/or the server.
The playing terminal is used for judging whether the first photo and/or the second photo are cached in the photo live broadcast room according to the query result; if yes, directly loading and displaying the face recognition features, the face image, the first photo and/or the first photo collection; if not, the playing terminal accesses the photo storage address information of the first photo in the cloud storage system, downloads the first photo, and displays the face recognition features, the face image, the first photo and/or the first photo collection.
The playing terminal is used for inputting personal information of the first photo and sending the personal information to the server; and the server is used for carrying out third association on the personal information, the face recognition characteristics, the live broadcast room information and the photo storage address information and storing the third association to the database.
The intelligent image transmission equipment is a smart phone provided with an APP; the APP is provided with a management module for transmitting the size and quality of an image and a live broadcast room module, the management module is used for compressing a first photo based on the preset size and quality of the image, and the live broadcast room module is used for receiving the first photo shot by a camera in the live broadcast room and performing information association on the first photo and the live broadcast room information;
the server is a cloud server or an independent server.
Wherein the cloud storage system comprises: a photo judging unit, a photo path calculating unit, a photo caching unit, a photo long-term storage unit and a photo editing unit, wherein,
the photo judgment unit is used for receiving and distributing massive photo access requests and inquiring and judging the existence of photos;
the photo path calculation unit is used for calculating and providing the shortest photo transmission path reaching the playing terminal;
the photo caching unit is used for accelerating the reading and writing speed of the photos and caching the result photos processed by the photo editing unit;
the photo long-term storage unit is used for providing photos in an original form for the live photos;
the photo editing unit is used for carrying out load balancing among massive computing nodes according to computing pressure, carrying out corresponding processing on an input original photo according to a photo processing requirement attached to an access request, and writing the processed original photo into the photo cache unit as output;
preferably, the photo judgment unit is further configured to judge whether the photo of the access request already exists in the photo cache unit; if yes, directly reading and returning to the server and/or the playing terminal; if the target photo does not exist, the target photo is promoted from the photo long-term storage unit to the photo cache unit, and then the target photo is read and returned to the server and/or the playing terminal.
In another aspect of the present invention, the present invention also provides a live photo broadcasting method with face recognition,
the server sends the first photo to a cloud storage system, and after the first photo is stored, the cloud storage system returns the first photo storage address information to the server;
the face recognition system responds to a processing request of face recognition sent by the server, accesses a first photo storage address and obtains a first photo, carries out face recognition processing on the first photo and returns face recognition characteristics of the first photo to the server, and the server carries out second association on the face recognition characteristics of the first photo, live broadcast room information and first photo storage address information and stores the second association in a first database;
the playing terminal uploads the second photo to the server and inquires an access request of the first photo;
the server responds to an access request of the playing terminal, sends the second photo to the face recognition system for face recognition processing to obtain the face recognition feature of the second photo, inquires the face recognition feature and the first photo storage address information which are the same as the face recognition feature of the second photo from the first database according to the second association and the face recognition feature of the second photo, and sends the inquiry result to the playing terminal;
the playing terminal displays the face recognition features, the face image, the first photo and/or the first photo collection according to the query result, preferably, the first photo collection is displayed in the form of a picture album, a splicing picture, a short video or a dynamic picture, and the picture is a thumbnail, a big picture, a middle picture or an original picture;
the first photo and the second photo have the same face recognition characteristics;
preferably, the system further comprises a camera and an intelligent image transmission device, wherein the intelligent image transmission device selects the live broadcast room, receives a first photo shot by the camera, performs first association on the first photo and the information of the live broadcast room, and uploads the first photo and the information of the live broadcast room to the server.
The face recognition system comprises a second database, a face information processing module and a face recognition module;
the second database stores the photos and the face recognition characteristic information thereof;
the face information processing module is used for receiving the face recognition characteristic information sent by the face recognition module, inquiring and/or updating the face recognition characteristic information in the second database, judging whether a person in the photo has a new person or not, if so, storing the photo in the second database, and if not, not storing the photo; the face information processing result is returned to the face recognition module and/or the server;
and the face recognition module is used for carrying out face recognition on the photo and sending the face recognition characteristic information to the face information processing module and/or the server.
The playing terminal is used for judging whether the first photo and/or the second photo are cached in the photo live broadcast room according to the query result; if yes, directly loading and displaying the face recognition features, the face image, the first photo and/or the first photo collection; if not, the playing terminal accesses the photo storage address information of the first photo in the cloud storage system, downloads the first photo, and displays the face recognition features, the face image, the first photo and/or the first photo collection.
The playing terminal inputs personal information of the first photo and sends the personal information to the server; and the server carries out third association on the personal information, the face recognition characteristics, the live broadcast room information and the photo storage address information and stores the information to the first database.
The intelligent image transmission equipment is a smart phone provided with an APP; the APP is provided with a management module for transmitting the size and quality of an image and a live broadcast room module, the management module compresses a first photo based on the preset size and quality of the image, and the live broadcast room module receives the first photo shot by a camera in the live broadcast room and performs information association on the first photo and the live broadcast room information;
the server is a cloud server or an independent server
Wherein the cloud storage system comprises a photo judging unit,
(1) configuring a running environment in a photo judgment unit; preferably, the storage space for migrating photos is configured in the photo judgment unit, the access mode and the access address of the server and/or the playing terminal are configured in the photo judgment unit, the original domain name resolution of the server and/or the playing terminal is directed to the photo judgment unit after the configuration is completed, and the photo access which is originally directed to the server and/or the playing terminal is adjusted to be uniform and is accessed through the photo judgment unit;
(2) preferably, the judging unit judges whether the photo of the access request exists in the photo cache unit or not, and if so, the judging unit directly reads and returns the photo to the server and/or the playing terminal; if the target photo does not exist, the target photo is promoted from the photo long-term storage unit to the photo cache unit, and then the target photo is read and returned to the server and/or the playing terminal.
In another aspect of the present invention, the present invention further provides a storage medium including a stored program, wherein the program performs the above-mentioned photo live broadcasting method.
Compared with the prior art, the invention has the following advantages:
(1) according to the live photo broadcasting system and the method thereof, when a professional photographer presses the shutter, the photos are automatically transmitted to the cloud storage system for the on-site user to browse and share instantly, and the whole process only needs 3-10 seconds. The method can be used for beautifully shooting (repairing) people and timely delivering, simultaneously supports display and sharing of playing terminals of WeChat friend circles and other microblog websites, improves the experience of customers, realizes instant uploading, downloading, instant browsing and sharing of massive photos, enables live photos to really become a new species, makes new advantages of the photography industry, generates qualitative change compared with non-traditional photography service, truly realizes live photos, and creates instant photos.
(2) The inventor finds that: when the photos are directly played, thousands of photos are frequently uploaded in a live broadcast room, more photos reach tens of thousands of photos, when the photos are directly played, hundreds of thousands of users are few, more millions of users watch the photos, each photo needs to correspond to a storage address, each user and watching of each photo need to submit an inquiry request and download once, a photo live broadcast platform has hundreds of or even thousands of activities every day, the photos are distributed and downloaded in different live broadcast rooms, hundreds of access requests and download watching frequently occur in the live broadcast room in a short time, high concurrency, high access and high download of the photos cause network and cloud storage system collapse of the live broadcast room, and the photos cannot be normally uploaded and downloaded and watched.
The intelligent image transmission device determines an uploaded target live broadcast room and receives a first photo, the first photo is in information correlation with the target live broadcast room information, the first photo and the target live broadcast room information are uploaded to a server, the server independently forwards the first photo to the cloud storage system, and the cloud storage system returns the photo storage address information to the server; the server stores the information of the live broadcast room and the information of the first photo storage address to a first database; therefore, the newly shot first photo is quickly and accurately synchronized to the target live broadcast rooms in the live broadcast room albums, and meanwhile, the association can be established.
When the audience watches the live broadcast, the server quickly determines a target live broadcast room through association, the information of a photo storage address, the information of the live broadcast room and the like are acquired at the same time, a first photo is downloaded through the cloud storage system, the first photo of the live broadcast room is synchronized to the target live broadcast room, the live broadcast of the photo is really realized, the problems that the live broadcast system of the photo cannot be matched with mass photo processing, the high delay time of data transmission and the like are solved, the safety and the stability of the live broadcast of the photo are improved, mass photo access requests and downloads can be simultaneously guaranteed, the classified management of albums of different live broadcast rooms is realized, the real-time uploading and synchronous management of mass photos in the same live broadcast room are realized, and the mass watching requirement of the live broadcast of the photo is met.
(3) In the process of live broadcasting of photos, the face recognition system carries out instant face recognition on the photos, then the server carries out second association on face recognition characteristics, live broadcasting room information and photo storage address information and stores the second association in a first database, the playing terminal uploads a second photo to the server and inquires an access request of a first photo with the same face recognition characteristics as the second photo, and the face recognition characteristics, a face image, the first photo and/or a first photo aggregate and the like are displayed according to the inquiry result, thereby realizing the pre-processing or instant processing of face recognition, carrying out face recognition on all the photos in the process of live broadcasting and storing and archiving face recognition information, when a large number of users use the face recognition function of the photos, rapidly calling the face recognition characteristics and saving the waiting time of face recognition operation, meanwhile, the instantaneity of live photo broadcasting can be kept.
The existing exclusive picture album needs to store a plurality of pictures in the same album, and when accessing the pictures, the album needs to be accessed, and then the first picture is downloaded and displayed. The invention can quickly generate personal exclusive picture albums after the photos are loaded through character recognition operation and face recognition operation, each retrieval character and person in the photos can correspondingly display one exclusive picture album, and a plurality of exclusive albums do not need to be established in a storage system, thereby avoiding the problems that the number of the exclusive albums is increased sharply, the storage is difficult, and the instant live broadcasting and the instant face recognition of the photos cannot be realized in the existing albums and methods.
The invention can quickly generate individual exclusive picture albums after the first photo is loaded through the face recognition operation, each of the first photos can generate one exclusive picture album, and a plurality of exclusive albums do not need to be established in the storage system, thereby avoiding the problems that the number of the exclusive albums is greatly increased and the storage is difficult, and the instant live broadcasting and the instant face recognition of the photos cannot be realized in the existing albums and methods.
(4) The face recognition system receives the face recognition characteristic information sent by the face recognition module, inquires and/or updates the face recognition characteristic information in the second database, judges whether a person in the photo is a new person, then determines whether to store the photo, and stores a large number of partial photos in the cloud storage system, and the face recognition system only stores a small number of characteristic photos, so that the photo storage pressure of the face recognition system is reduced, the photos can be shared and uploaded and watched in a live broadcast manner, and the face recognition is quickly realized.
(5) According to the live photo broadcasting system, the server judges whether the photo stores the first photo and/or the second photo, if yes, the photo is displayed through the cache, and if not, the photo is loaded and displayed. By the method, the photos can be displayed in a live broadcast manner, all cached character recognition information and all photos related to face recognition can be further quickly acquired, the photos can be saved, waiting time for the character recognition processing and the face recognition processing can be saved, a user can check all photos related to people without turning over all photos, user time is saved, operation of the mobile phone is more convenient and quicker, and the mobile phone is more humanized.
(6) The cloud storage system of the invention introduces a photo cache unit, a photo judgment unit, a photo path calculation unit and a photo editing unit on the basis of a long-term photo storage unit, wherein the photo editing unit processes an original photo, converts the original photo into different scene photos such as a large image, a middle image, a thumbnail, a watermark photo, a rotation photo, a splicing image and the like, and then outputs and writes the different scene photos into the photo cache unit, so that the different scene photos are quickly read in the photo cache unit with the help of the photo judgment unit and the photo path calculation unit, the real-time display of the photos is realized, and the multi-scene and diversified viewing requirements are met. And moreover, photo judgment management and path calculation are introduced, so that the aims of accessing a cloud storage system and editing photos in a completely non-invasive mode and accelerating photo access are fulfilled. The reading and writing speed of the photos is accelerated, and the request pressure of the long-term storage unit of the photos is greatly reduced, so that the normal operation of massive photo access requests, massive downloading and massive photo distribution is ensured.
(7) In the present invention, a photo judgment unit judges whether a photo of an access request already exists in a photo cache unit; if yes, directly reading and returning to the server and/or the playing terminal; if the target photo does not exist, the target photo is promoted from the photo long-term storage unit to the photo cache unit, and then the target photo is read and returned to the server and/or the playing terminal.
Each live broadcast room has thousands of photos, and each photo corresponds to dozens of unqualified photos (thumbnails, middle pictures, large pictures, high-definition pictures, watermark pictures, rotation pictures, splicing pictures, dynamic pictures and the like) during browsing and storing, the invention can rapidly open the live broadcast room by the system setting and the method, and downloads the photos and the photos with the specifications, thereby avoiding the problems of storage, filing, access and downloading: the pictures are disordered among different specifications, and the network and the cloud storage system are crashed due to high concurrency, high request and high downloading.
(8) In the invention, the storage space of the playing terminal can be saved: firstly, when a live broadcast room is browsed, a playing terminal downloads a thumbnail of a picture at the cloud end and displays the downloaded thumbnail in the live broadcast room; and secondly, when a live broadcast room is browsed, the user directly requests to browse the photos without downloading the photos to the local playing terminal, and when the browsing is finished, the local playing terminal does not store the cache files of the browsed photos.
Drawings
Fig. 1 is a block diagram of a live photo system provided in the present invention;
fig. 2 is a block diagram of a cloud storage system in a live photo system according to the present invention;
FIG. 3 is a flow chart of a method for live broadcasting of photos according to an embodiment of the present invention;
FIG. 4 is a flowchart illustrating a photo access process of a cloud storage system according to the present invention;
reference numerals: the system comprises a camera 1, an intelligent image transmission device 2, a server 3, a cloud storage system 4, a photo judgment unit 41, a photo path calculation unit 42, a photo cache unit 43, a long-term photo storage unit 44, a photo editing unit 45, a face recognition system 5 and a playing terminal 6.
Detailed Description
The technical solutions in the embodiments of the present application will be described clearly and completely with reference to the accompanying drawings in some embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments.
All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It is to be understood that the terminology used in the embodiments of the present application is for the purpose of describing particular embodiments only, and is not intended to be limiting of the application. As used in the examples of this application and the appended claims, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. The expressions "first", "second", "the first" and "the second" are used for modifying the corresponding elements without regard to order or importance, and are used only for distinguishing one element from another element without limiting the corresponding elements.
The play terminal according to some embodiments of the present application may be an electronic display device capable of displaying photos, and the electronic display device may include one or a combination of a personal computer (PC, e.g., a tablet computer, a desktop computer, a notebook, a netbook, a PDA, a mobile phone, an e-book reader, a Portable Multimedia Player (PMP), a virtual reality device (VR), a wearable device, and the like. According to some embodiments of the present application, the wearable device includes one or a combination of several of an accessory type (e.g., watch, bracelet, eye, or Head Mounted Device (HMD)), an integration type (e.g., electronic garment), a decoration type (e.g., built-in electronic device), and the like. In some embodiments of the present application, the electronic display device may be flexible, not limited to the above devices, or may be a combination of one or more of the above devices.
In the invention, the camera can be a digital card camera and a digital single lens reflex camera commonly used in the photographic industry.
As shown in fig. 1, an embodiment of the present application provides a live photo system with face recognition, where the system includes a server 3, a cloud storage system 4, a camera 1, an intelligent image transfer device 2, and a face recognition system 5; the intelligent picture transmission device 2 is used for selecting a live broadcast room, receiving a first picture shot by the camera 1, performing first association on the first picture and the live broadcast room information, and uploading the first picture and the live broadcast room information to the server 3. The intelligent image transmission device 2 is in communication connection with the camera 1 through a Wifi network and receives a first photo shot by the camera, and also can be in communication connection through a data line. The first photo and the live room information can be uploaded to the server 3 through a mobile network (3G, 4G, 5G) and the Internet.
The server 3 is used for sending the first photo to the cloud storage system 4, receiving first photo storage address information returned by the cloud storage system 4, and performing second association on the face recognition feature of the first photo, live broadcast room information and the first photo storage address information and storing the second photo to the first database by the server 3; and responding to an access request of the playing terminal 6, sending the second photo to the cloud storage system 4 for face recognition, inquiring face recognition characteristics and first photo storage address information which are the same as the face recognition characteristics of the second photo from the first database according to the second association and the face recognition characteristics of the second photo, and sending an inquiry result to the playing terminal 6. In the present invention, the photo storage address information includes a name, a size, a format, a storage address, etc. of the first photo.
The face recognition system 5 is configured to respond to a face recognition processing request sent by the server 3, access the first photo storage address and obtain the first photo, perform face recognition processing on the first photo and return the face recognition feature of the first photo to the server 3, and perform face recognition processing on the second photo and return the face recognition feature of the second photo to the server 3.
The playing terminal 6 is configured to upload the second photo to the server 3 and query an access request for a first photo having a face recognition feature the same as that of the second photo, and display the face recognition feature, the face image and/or the first photo according to the query result, preferably, the face image and the first photo are displayed in the form of a picture album, a mosaic, a short video or a dynamic picture, the picture is a thumbnail, a large picture, a middle picture or an original picture, the mosaic is formed by splicing a plurality of photos, and the mosaic can be made by a conventionally used splicing method, such as top-bottom splicing, nine-square splicing, free splicing and the like.
In the present invention, the playing terminal 6 may use a conventional display manner to live the first photo in the room, for example, a webpage, an applet, and a client APP.
In an embodiment of the present invention, the server 3 is an independent server, and the independent server has software and hardware resources of the whole server for a client, and can configure itself or implement various network services such as web, mail, ftp and the like through a host management tool. As an alternative embodiment, the server 3 may be a cloud server, which is a group of cluster servers virtually representing a plurality of independent server departments, each server in the cluster having a mirror image of the cloud server.
In the present invention, the condition for judging that the face recognition feature of the first photo matches with the second photo is as follows: the similarity of the face recognition features reaches more than 80 percent.
In the present invention, the face recognition system 5 includes a second database, a face information processing module, and a face recognition module. The second database is used for storing the photos and the face recognition characteristic information thereof; the face information processing module is used for receiving the face recognition characteristic information sent by the face recognition module, inquiring and/or updating the face recognition characteristic information in the second database, judging whether a person in the photo has a new person or not, and if so, storing the photo in the second database; if not, the photo is not saved. After the face recognition result, the face information processing module returns the face information processing result to the face recognition module and/or the server 3, so that the face recognition system 5 only stores a small number of characteristic photos, thereby reducing the photo storage pressure of the face recognition system 5, ensuring that the photos can be shared and uploaded and watched in live broadcast, and quickly realizing face recognition. And the face recognition module is used for carrying out face recognition on the photos and sending the face recognition characteristic information to the face information processing module and/or the server 3. In the present invention, the conditions for determining whether or not there is a new person in the picture are: face recognition feature information with the similarity of the face recognition features reaching more than 80%.
The face recognition system can support face recognition of pictures or real photos and return information such as face positions, face recognition characteristics and the like. The face recognition system can extract and analyze the face features in the picture. Accurate face detection and face recognition can be realized, and the method comprises face detection and analysis, multi-face detection, facial feature positioning, face comparison and search, age-crossing face recognition and the like. The Face Recognition system of the invention can adopt Tencent cloud Face Recognition (Face Recognition) or machine equipment with a Face Recognition function.
In the invention, the face recognition features comprise feature information of conventional face recognition, such as head portrait five sense organs information, head portrait position information in the photo, face number in the photo, age and gender of the head portrait and other conventional face recognition information.
In the present invention, the photos uploaded to the cloud server 3 exist in a file form, and include attribute information, such as photo size, shooting time, camera model, pixels, and the like.
The playing terminal 6 is used for judging whether the live photo room has the cache of the first photo and/or the second photo according to the query result; if yes, directly loading and displaying the face recognition features, the face image, the first photo and/or the first photo collection; if not, the playing terminal 6 accesses the photo storage address information of the first photo in the cloud storage system 4, downloads the first photo, and displays the face recognition feature, the face image, the first photo and/or the first photo collection.
The playing terminal 6 is used for inputting personal information of the face image and sending the personal information to the server 3, wherein the personal information can comprise information such as name, age, height, academic calendar, job title, honor and the like, and the participant serves as guest personal information; the server 3 is used for carrying out third association on the personal information, the face recognition features, the live broadcast room information and the photo storage address information and storing the personal information, the face recognition features, the live broadcast room information and the photo storage address information into the first database.
In the present invention, the first association, the second association, and the third association may use a method of conventionally establishing an association with a database, for example, the association is implemented in a table, a column, a key, an index, a relationship, a constraint, and the like, so as to read and retrieve information from the server 3.
In an embodiment of the present invention, the smart image transmission device 2 may be a smart phone installed with APP (application), as a changeable implementation, or other smart multimedia transmission devices installed with application, and the smart multimedia transmission device may be provided with a wifi module, a data transmission module, a mobile network module (including 3G, 4G, 5G, etc.), a chip (such as an SOC chip), and the like. Such as a picture flash BOX (P-BOX), VBox6 from shanghai network technologies ltd, and the like. The storage card can be accessed by a universal Wifi network such as a smart phone 2 (a smart phone, such as an apple phone or an android system phone). When the intelligent image transmission device 2 initiates an HTTP GET command to the photo file in the memory card, the content of the returned photo file is stored.
When the smart image transfer device 2 is a smart phone, the APP is used for receiving a notification that the camera 1 newly takes a first photo, and information of an address of the newly-taken first photo in the memory card of the camera 1, and obtaining the photo (the photo includes information of the shooting time of the first photo, the name, the size, the resolution, the album model, the aperture and the like) according to the photo address, and after the photo is successfully obtained, refreshing a first photo list in the APP.
The APP is provided with a management module for transmitting the size and the quality of the image and a live broadcast room module, the minimum size of a long edge of the image can be 1024px, and the maximum size of the long edge of the image can be the original first photo of the image. The management module is used for compressing the first photo based on the preset image size and quality, and the live broadcast room module is used for receiving the first photo shot by the camera 1 in the live broadcast room and carrying out information association on the first photo and the live broadcast room information.
The APP comprises an automatic transmission mode and a manual transmission mode; and the automatic transmission mode is used for automatically downloading the information of the first photo address in the memory card of the camera 1 from the memory card of the camera 1 to the smart phone and then automatically uploading the information to the server 3 after receiving the notification that the camera 1 adds the first photo and the information of the first photo address in the memory card of the camera 1. And the manual transmission mode is used for establishing communication connection between the smart phone and the camera 1, sending the shooting information to the smart phone by the camera 1, manually selecting the image to be uploaded in the APP, and then uploading the image to the server 3.
As an alternative embodiment of the present invention, as shown in fig. 2, the cloud storage system 4 may include: a photo judgment unit 41, a photo path calculation unit 42, a photo cache unit 43, a photo long-term storage unit 44, and a photo editing unit 45.
In an embodiment of the present invention, the photo judgment unit 41 is configured to receive and distribute a massive photo access request, and perform photo existence query judgment.
The photo path calculation unit 42 is used for calculating and providing the shortest photo transmission path to the playing terminal 6, and the problem that photos are uploaded at a plurality of nodes without causing photo inconsistency is solved. The photo path calculation unit 42 also supports an upload-download bidirectional transfer acceleration function for distributing photos at high speed.
The photo cache unit 43 is used for accelerating the reading and writing speed of the photos and caching the result photos processed by the photo editing unit 45, the photo cache unit 43 can obviously reduce the request pressure on the long-term photo storage unit 44 and the data processing unit, the photos can be quickly downloaded from the photo cache unit 43, and the opening speed of the live photo room is accelerated.
The photo long-term storage unit 44 is used to provide photos in an original form for the live photos. In actual use, the photos stored in the long-term storage unit 44 are kept permanently effective, which greatly reduces and eliminates the dependence on external systems, while the photos stored in the conventional content distribution network are deleted in stages due to the limitation of the storage space of the cache unit.
In another embodiment of the present invention, in order to further improve the computing performance of the cloud storage system 4, the cloud storage system 4 further includes a photo editing unit 45. The photo editing unit 45 is configured to balance loads among a large number of computing nodes according to the computing pressure, perform corresponding processing on the input original photo according to the photo processing requirement attached to the access request, and write the processed input original photo as an output to the target location, and is preferably a photo caching unit 43. The photo editing unit 45 includes a photo editing and mounting module for mounting a specific photo processing program, so that the photo editing or processing process can be executed with stable efficiency in a high-concurrency scene.
In another embodiment of the present invention, the photo judgment unit 41 is configured to set a storage space for the migrated photo; the access mode and the access address for configuring the server 3 and the playing terminal 6; the original domain name resolution of the server 3 and/or the playing terminal 6 is directed to the configured photo judgment unit 41, and photo access which is originally directed to the server 3 and/or the playing terminal 6 is adjusted to be uniform and is accessed through the photo judgment unit 41.
In another embodiment of the present invention, the photo determining unit 41 is further configured to determine whether the photo requested by the access request already exists in the photo caching unit 43, and if so, directly read and return the photo to the server 3 and the playing terminal 6; if the target photo does not exist, the target photo is promoted from the photo long-term storage unit 44 to the photo cache unit 43, and then read and returned to the server 3 and the playing terminal 6, and preferably, before the target photo is promoted from the photo long-term storage unit 44 to the photo cache unit 43, whether the target photo is converted into a photo meeting the final requirement through the photo editing unit 45 is determined according to whether the access request contains the photo editing rule description.
In view of the above situation, the editing rule of the photograph of the present invention: the photo editing unit 45 compresses an original photo into a plurality of photos with different sizes, performs watermarking and rotation operations on the original photo and the compressed photo, further generates a composite photo, corresponds each compressed photo and the composite photo to a file, performs load balancing between massive computing nodes (for example, inode nodes) according to computing pressure, outputs a processed result file and writes the processed result file into the photo caching unit 43, completes caching of the photos, and a plurality of photo files of the original photo have different indexes and data caching positions.
After the original photo is processed by the editing rule, different browsing requirements of a user can be met in photo browsing scenes such as a playing terminal 6 (cloud photo album) and the like, or the method can be suitable for different network environments, and the same photo needs to be processed into a plurality of sizes to deal with different application scenes, and a watermark photo, a rotating photo and a spliced image of a plurality of photos are loaded. For example, browsing photos in a cloud album, a user may typically choose to view the photos in different sizes, such as thumbnail, medium, large, high-definition, etc., and select a watermark, rotation, mosaic, dynamic (e.g., gif-format), etc. Moreover, the editing rule can avoid consuming a large amount of bottom-layer nodes and storage space, and can also avoid the condition that the data of photos with multiple sizes are inconsistent, such as partial size loss, or the two sizes corresponding to the original photos are not the same.
The invention also provides a photo live broadcasting method. In order to facilitate understanding of the present embodiments, the present embodiments will be described in detail below with reference to the accompanying drawings. It should be emphasized that, although the photo live broadcasting method provided by the embodiment of the present invention is described by taking a photo live broadcasting system as an example, the present invention is only described for better illustration, and is not limited to the present invention.
As shown in fig. 3, the present invention provides a flowchart of an embodiment of a live photo broadcasting method. The following is a detailed description:
step S31, the intelligent image transmission device is in communication connection with the camera;
step S32, the intelligent image transmission equipment selects a live broadcast room, receives a first photo shot by a camera, performs first association on the first photo and the live broadcast room information, and uploads the first photo and the live broadcast room information to a server through a wifi network or a mobile network (3G, 4G, 5G, and the like);
in the invention, after the communication connection between the intelligent image transmission device and the single-lens reflex device is successful, when the camera successfully takes a picture, the intelligent image transmission device (the mobile phone end) receives the notification of newly adding the first picture and feeds back the address of the first picture in the memory card of the camera, the intelligent image transmission device acquires the first picture according to the address of the first picture, and refreshes the first picture received in the intelligent image transmission device after the first picture is successfully acquired, thereby realizing the transmission of the first picture.
In one embodiment of the invention, after the smart phone can establish a communication connection with the camera through the APP. Whenever the camera shoots a new first photo, the APP can receive the notification of the camera to shoot the new first photo and the information of the new first photo address in the camera memory card, then the APP obtains the first photo according to the photo address (the file of the photo contains the photo shooting time, the photo name, the size, the resolution ratio, the album model, the aperture and other information), after the obtaining is successful, the photo list in the APP at the mobile phone end is refreshed, and the APP shows the new first photo to be shot in the live broadcast room.
In another embodiment of the invention, the APP is provided with a management module for transmitting the size and quality of the image and a live broadcast room module, the management module compresses the first photo based on the preset size and quality of the image, and the live broadcast room module receives the first photo shot by the camera in the live broadcast room and associates the first photo with the information of the live broadcast room.
In an embodiment of the present invention, the APP includes an automatic transmission mode and a manual transmission mode; and the automatic transmission mode is used for automatically downloading the information of the new first added photo of the camera and the address of the photo in the memory card of the camera to the smart phone from the memory card of the camera and then automatically uploading the information to the server. And in the manual transmission mode, after the communication connection is established between the smart phone and the camera, the camera sends the new first photo to the smart phone, and the image to be uploaded is manually selected in the APP and then uploaded to the server.
In the invention, the intelligent image transmission equipment uploads the first photo and the live broadcast room information to the server, and the uploading mode can be as follows: the wireless data services of the mobile phone operator comprise 3G, 4G, 5G and other network services. The server sends the first photo to a cloud storage system through a network;
step S33, the server sends the first photo to the cloud storage system, after the first photo is stored, the cloud storage system returns the first photo storage address information to the server, and the server stores the live broadcast room information, the first photo storage address information and the first correlation information to a first database;
step S34, the server sends out a face recognition processing request of the first photo, the face recognition system responds to the processing request, accesses the first photo storage address and obtains the first photo, carries out face recognition processing on the first photo and returns the face recognition characteristic of the first photo to the server, and the server carries out second association on the face recognition characteristic of the first photo, the live broadcast room information and the first photo storage address information and stores the face recognition characteristic of the first photo in a first database;
step S35, the playing terminal uploads the second photo to the server and inquires an access request of the first photo with the same face recognition characteristic as the second photo;
step S36, the server sends the second photo to a face recognition system for face recognition to obtain the face recognition feature of the second photo, according to the second association and the face recognition feature of the second photo, the face recognition feature same as the face recognition feature of the second photo and the storage address information of the first photo associated with the face recognition feature are inquired from the first database, and the inquiry result is sent to the playing terminal;
step S37, displaying the face recognition feature, the face image, the first photo and/or the first photo collection according to the query result, preferably, displaying the face image and the first photo in the form of a picture album, a short video or a dynamic picture, wherein the picture is a thumbnail, a big picture, a middle picture or an original picture.
The photo live broadcasting system method realizes instant uploading and downloading of a large number of first photos, instant browsing and sharing of tens of millions of users, realizes album classification management of different live broadcasting rooms, realizes real-time uploading and synchronous management of a large number of photos in the same live broadcasting room, meets the mass watching requirement of photo live broadcasting, solves the problems that the uploading and downloading of the first photos are slow and a network and cloud storage system is broken down due to high concurrency, high access and high downloading, and how to realize instant face recognition of the first photos, greatly reduces the waiting time for face recognition (dozens of face recognition photos can be displayed within 1 second, while the existing face recognition face has the time of more than 10 seconds, even several minutes), and further realizes live broadcasting of the photos.
In another embodiment of the live photo broadcasting method according to the present invention, compared to the live photo broadcasting method shown in fig. 3, steps S31 to S35 are the same, and are different from the following steps:
step S36, the playing terminal selects a first photo in the photo live broadcast room, sends an access request of the face recognition feature of the selected photo to the server, the server inquires the face recognition feature from the first database according to the first association and the second association, sends the face recognition feature to the playing terminal, and displays the face recognition feature in the photo live broadcast room and/or intercepts a face image from the photo according to the face recognition feature;
step S37, the playing terminal selects the face image in the live photo room, sends the access request of the associated photo containing the selected face image to the server, the server inquires the information of the associated photo from the first database according to the face recognition feature, the first association and the second association, and then sends the information to the playing terminal, and the playing terminal judges whether the live photo room has a cache of the associated photo; if yes, directly loading and displaying the associated photo; if not, the playing terminal accesses the photo storage address information of the associated photo in the cloud storage system, and downloads and displays the associated photo.
In the embodiment of the invention, the information of the photos and the collections of the photos can be edited, and the playing terminal inputs personal information and sends the personal information to the server; and the server carries out third association on the personal information, the face recognition characteristics, the live broadcast room information and the photo storage address information and stores the information to the first database.
By the method, the face image of the selected photo and the face recognition feature of the selected photo can be directly obtained, and the cached photo associated with the face recognition can be quickly obtained through the face image and the face recognition feature, so that the photo is displayed in a form of a picture album, the photo loading is saved, the waiting time of the face recognition operation is saved, a user can check the photos of all associated people without turning over all the photos, the user time is saved, the operation of the mobile phone is more convenient and quicker, and the mobile phone is more humanized.
Since the photo system includes any one of the photo live broadcast methods provided by the embodiments of the present invention, other beneficial effects that can be achieved by any one of the photo live broadcasts provided by the embodiments of the present invention can be achieved, which are detailed in the foregoing embodiments and will not be described herein again.
As shown in fig. 4, a flowchart of another embodiment of a live photo broadcasting method provided by the present invention is schematically shown. The present embodiment specifically describes the operation steps of the cloud storage system.
Step S61, first, configuring an operating environment in the photo judgment unit; the method comprises the following steps:
(1) configuring a storage space for transferring the photos in a photo judgment unit;
(2) configuring an access mode and an access address of a server and/or a playing terminal in a photo judgment unit;
(3) and adjusting the original domain name resolution of the server and/or the playing terminal to the configured photo judgment unit, and adjusting the photo access which is originally directly directed to the server and/or the playing terminal to be uniform and accessing through the photo judgment unit.
Step S62, the server and/or the playback terminal sends an access request to the cloud storage system, and the cloud storage system completely executes the photo access service process according to the access request, that is, responds to the access request of the server and/or the playback terminal to the photo.
The following describes in detail the steps of the cloud storage system executing the user access request:
in step S621, first, the server and/or the broadcasting terminal requests access to the data photo judgment unit,
step S622, requesting access to the photo cache unit;
step S623, if the accessed target photo exists in the photo cache unit, step S6231 is executed, that is, the photo in the photo cache unit is read and returned to the server and/or the playing terminal, and step S63 is executed to complete the reading.
In step S623, if the accessed target photograph is not present in the photograph caching unit, the flow proceeds to step S6232, and the photograph long-term storage unit is accessed.
Step S6233, before the target photo is promoted from the photo long-term storage unit to the photo cache unit, determines whether to transform the target photo into a photo meeting the final requirement via the photo editing unit according to whether the access request includes the photo editing rule description. If editing is necessary, the process proceeds to step S62331, where the photo is edited or processed, and then the process proceeds to step S6234.
Step 6234, writing the accessed photo or the photo edited or processed in step 62331 into the photo cache unit and returning to the server and/or the playing terminal, and proceeding to step S63 to complete the access.
The storage medium of the present invention may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.
Since the program stored in the storage medium may execute the steps in any photo live broadcasting method provided in the embodiments or examples of the present invention, beneficial effects that can be achieved by any photo live broadcasting method provided in the embodiments or examples of the present invention may be achieved, which are detailed in the foregoing examples and will not be described herein again.
It should be noted that the various features described in the foregoing detailed description may be combined in any suitable manner and still fall within the scope of the invention disclosed. In addition, any combination of the various embodiments of the present invention is also possible, and the same should be considered as the disclosure of the present invention as long as it does not depart from the spirit of the present invention.
The preferred embodiments of the present invention have been described in detail with reference to the accompanying drawings, however, the present invention is not limited to the specific details of the above embodiments, and various simple modifications can be made to the technical solution of the present invention within the technical idea of the present invention, and these simple modifications are within the protective scope of the present invention.

Claims (22)

1. A live photo system with face recognition is characterized by comprising a server, a cloud storage system, a playing terminal, a face recognition system, a camera and intelligent picture transmission equipment;
the server is used for sending the first photo to the cloud storage system for storage, receiving first photo storage address information returned by the cloud storage system, performing second association on the face recognition characteristic of the first photo, live broadcast room information and the first photo storage address information, and storing the second photo storage address information in the first database; the access request for responding to the playing terminal to upload the second photo to the server and inquire the first photo is used for sending the second photo to the face recognition system for face recognition; inquiring the storage address information of the first photo from the first database according to the second association and the face recognition characteristics of the second photo, and sending the inquiry result to the playing terminal;
the face recognition system is used for responding to a face recognition processing request sent by the server, accessing a first photo storage address and acquiring a first photo, performing face recognition processing on the first photo and returning the face recognition characteristics of the first photo to the server, and performing face recognition processing on the second photo and returning the face recognition characteristics of the second photo to the server;
the playing terminal is used for uploading the second photo to the server and inquiring the access request of the first photo, and displaying the face recognition feature, the face image, the first photo and/or the first photo collection according to the inquiry result; the first photo and the second photo have the same or matched face recognition characteristics.
2. The system of claim 1, wherein the face recognition system comprises:
preferably, the first photo album is displayed in the form of a photo album, a mosaic, a short video or a moving picture, and the picture is a thumbnail, a large picture, a medium picture or an original picture.
3. The system of claim 1, wherein the face recognition system comprises:
the intelligent picture transmission equipment is used for selecting a live broadcast room, receiving a first picture shot by a camera, performing first association on the first picture and the information of the live broadcast room, and uploading the first picture and the information of the live broadcast room to a server.
4. The system of claim 1, wherein the face recognition system comprises:
the second database is used for storing the photos and the face recognition characteristic information thereof;
the face information processing module is used for receiving the face recognition characteristic information sent by the face recognition module, inquiring and/or updating the face recognition characteristic information in the second database, judging whether a person in the photo has a new person, if so, storing the photo in the second database, and if not, not storing the photo; the face information processing result is returned to the face recognition module and/or the server;
and the face recognition module is used for carrying out face recognition on the photo and sending the face recognition characteristic information to the face information processing module and/or the server.
5. The system according to claim 1, wherein the playing terminal is configured to determine whether the live photo studio has a cache of the first photo and/or the second photo according to the query result; if yes, directly loading and displaying the face recognition features, the face image, the first photo and/or the first photo collection; if not, the playing terminal accesses the first photo storage address information of the first photo in the cloud storage system, downloads the first photo, and displays the face recognition feature, the face image, the first photo and/or the first photo collection.
6. The system according to any one of claims 1-5, wherein the display terminal is configured to input personal information of the first photo and send the personal information to the server; the server is used for carrying out third association on the personal information, the face recognition features, the live broadcast room information and the first photo storage address information and storing the third association to the first database.
7. The system according to any one of claims 1-5, wherein the smart biographical equipment is a smartphone with an APP installed; the APP is provided with a management module for transmitting the size and quality of an image and a live broadcast room module, the management module is used for compressing the picture based on the preset size and quality of the image, and the live broadcast room module is used for receiving a first picture shot by a camera in the live broadcast room and performing information first association on the first picture and the live broadcast room information;
the server is a cloud server or an independent server.
8. The system of any of claims 1-5, wherein the cloud storage system comprises: a photo judging unit, a photo path calculating unit, a photo caching unit, a photo long-term storage unit and a photo editing unit, wherein,
the photo judgment unit is used for receiving and distributing massive photo access requests and inquiring and judging the existence of photos;
the photo path calculation unit is used for calculating and providing the shortest photo transmission path reaching the playing terminal;
the photo caching unit is used for accelerating the reading and writing speed of the photos and caching the result photos processed by the photo editing unit;
the photo long-term storage unit is used for providing photos in an original form for the live photos;
the photo editing unit is used for carrying out load balancing among massive computing nodes according to computing pressure, carrying out corresponding processing on an input original photo according to a photo processing requirement attached to an access request, and writing the processed original photo into the photo cache unit as output.
9. The system of claim 8,
the photo judging unit is also used for judging whether the photo of the access request exists in the photo caching unit; if yes, directly reading and returning to the server and/or the playing terminal; and if the target photo does not exist, the target photo is promoted to the photo cache unit from the photo long-term storage unit, and then the target photo is read and returned to the server and/or the playing terminal.
10. The system of claim 9,
before the target photo is promoted from the photo long-term storage unit to the photo cache unit, whether the target photo is converted into a photo meeting the final requirement through the photo editing unit is determined according to whether the access request contains the photo editing rule description.
11. A live photo broadcasting method with face recognition is characterized in that,
the server sends the first photo to a cloud storage system, and after the first photo is stored, the cloud storage system returns the first photo storage address information to the server;
the face recognition system responds to a processing request of face recognition sent by the server, accesses a first photo storage address and obtains a first photo, carries out face recognition processing on the first photo and returns face recognition characteristics of the first photo to the server, and the server carries out second association on the face recognition characteristics of the first photo, live broadcast room information and first photo storage address information and stores the second association in a first database;
the playing terminal uploads the second photo to the server and inquires an access request of the first photo; the server responds to an access request of the playing terminal, sends the second photo to the face recognition system for face recognition processing to obtain the face recognition feature of the second photo, inquires the face recognition feature and the first photo storage address information which are the same as the face recognition feature of the second photo from the first database according to the second association and the face recognition feature of the second photo, and sends the inquiry result to the playing terminal;
the playing terminal displays the face recognition features, the face image, the first photo and/or the first photo collection according to the query result;
the first photo and the second photo have the same face recognition characteristics.
12. The method of claim 11,
the first photo collection is displayed in the form of a photo album, a spliced picture, a short video or a dynamic picture, and the picture is a thumbnail, a big picture, a middle picture or an original picture.
13. The method of claim 11,
the system further comprises a camera and intelligent picture transmission equipment, wherein the intelligent picture transmission equipment selects the live broadcast room, receives a first photo shot by the camera, performs first association on the first photo and the information of the live broadcast room, and uploads the first photo and the information of the live broadcast room to the server.
14. The method of claim 11, wherein the face recognition system comprises a second database, a face information processing module, and a face recognition module;
the second database stores the photos and the face recognition characteristic information thereof;
the face information processing module is used for receiving the face recognition characteristic information sent by the face recognition module, inquiring and/or updating the face recognition characteristic information in the second database, judging whether a person in the photo has a new person or not, if so, storing the photo in the second database, and if not, not storing the photo; the face information processing result is returned to the face recognition module and/or the server;
and the face recognition module is used for carrying out face recognition on the photo and sending the face recognition characteristic information to the face information processing module and/or the server.
15. The method according to claim 11, wherein the play terminal is configured to determine whether the live photo studio has the cache of the first photo and/or the second photo according to the query result; if yes, directly loading and displaying the face recognition features, the face image, the first photo and/or the first photo collection; if not, the playing terminal accesses the first photo storage address information of the first photo in the cloud storage system, downloads the first photo, and displays the face recognition feature, the face image, the first photo and/or the first photo collection.
16. The method according to any one of claims 11-15, wherein the cast terminal inputs personal information of the first photo and transmits the personal information to the server; and the server carries out third association on the personal information, the face recognition characteristics, the live broadcast room information and the first photo storage address information and stores the personal information, the face recognition characteristics, the live broadcast room information and the first photo storage address information in a first database.
17. The method according to any one of claims 11-15, wherein the smart image transmission device is a smartphone equipped with an APP; the APP is provided with a management module for transmitting the size and quality of an image and a live broadcast room module, the management module compresses a photo based on the preset size and quality of the image, the live broadcast room module receives a first photo shot by a camera in the live broadcast room, and information first association is carried out on the first photo and the live broadcast room information;
the server is a cloud server or an independent server.
18. The method according to any one of claims 11-15, wherein the cloud storage system comprises a photo determination unit,
(1) configuring a running environment in a photo judgment unit;
(2) the judgment unit responds to the access request of the server and/or the playing terminal to the photo.
19. The method of claim 18,
the storage space of the transferred photos is configured in the photo judgment unit, the access mode and the access address of the server and/or the playing terminal are configured in the photo judgment unit, the original domain name resolution of the server and/or the playing terminal points to the configured photo judgment unit, and the photo access which is originally and directly pointed to the server and/or the playing terminal is adjusted to be uniform and is accessed through the photo judgment unit.
20. The method of claim 18,
the judging unit judges whether the photo of the access request exists in the photo caching unit, and if so, the photo is directly read and returned to the server and/or the playing terminal; and if the target photo does not exist, the target photo is promoted to the photo cache unit from the photo long-term storage unit, and then the target photo is read and returned to the server and/or the playing terminal.
21. The method of claim 20,
before the target photo is promoted from the photo long-term storage unit to the photo cache unit, whether the target photo is converted into a photo meeting the final requirement through the photo editing unit is determined according to whether the access request contains the photo editing rule description.
22. A storage medium characterized in that it comprises a stored program, wherein the program executes the photo live method of any one of claims 7 to 12.
CN201910441236.1A 2019-05-24 2019-05-24 Live photo broadcasting system with face recognition function and method thereof Active CN110191170B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910441236.1A CN110191170B (en) 2019-05-24 2019-05-24 Live photo broadcasting system with face recognition function and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910441236.1A CN110191170B (en) 2019-05-24 2019-05-24 Live photo broadcasting system with face recognition function and method thereof

Publications (2)

Publication Number Publication Date
CN110191170A CN110191170A (en) 2019-08-30
CN110191170B true CN110191170B (en) 2022-05-17

Family

ID=67717763

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910441236.1A Active CN110191170B (en) 2019-05-24 2019-05-24 Live photo broadcasting system with face recognition function and method thereof

Country Status (1)

Country Link
CN (1) CN110191170B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114884925B (en) 2022-04-18 2023-04-18 深圳市绿联科技股份有限公司 Method, device and system for transmitting composite photo data and electronic equipment

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201491075U (en) * 2009-03-24 2010-05-26 深圳市聚合互动科技有限公司 Mobile phone with instant picture shooting and uploading
CN102378001A (en) * 2010-08-11 2012-03-14 中国电信股份有限公司 Mobile terminal supporting picture live broadcast mode, video live broadcast method thereof and system thereof
CN102594896A (en) * 2012-02-23 2012-07-18 广州商景网络科技有限公司 Electronic photo sharing method and system for same
CN105306249A (en) * 2015-07-10 2016-02-03 深圳市美贝壳科技有限公司 Method for displaying uploading status in real time in process of uploading pictures to Cloud
CN106937012A (en) * 2015-12-31 2017-07-07 安富国 A kind of client timing uploading pictures realize the live method of online picture
CN106960172A (en) * 2016-01-08 2017-07-18 中兴通讯股份有限公司 Personal identification processing method, apparatus and system
WO2018040910A1 (en) * 2016-09-02 2018-03-08 丰唐物联技术（深圳）有限公司 Live broadcast method and system
CN108696724A (en) * 2018-05-29 2018-10-23 哈尔滨市舍科技有限公司 The live broadcast system of high definition photo can be obtained immediately

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140006551A1 (en) * 2012-07-02 2014-01-02 Nti Corporation System and method for backing up data
CN106096011A (en) * 2016-06-23 2016-11-09 北京小米移动软件有限公司 Method for picture sharing and device

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201491075U (en) * 2009-03-24 2010-05-26 深圳市聚合互动科技有限公司 Mobile phone with instant picture shooting and uploading
CN102378001A (en) * 2010-08-11 2012-03-14 中国电信股份有限公司 Mobile terminal supporting picture live broadcast mode, video live broadcast method thereof and system thereof
CN102594896A (en) * 2012-02-23 2012-07-18 广州商景网络科技有限公司 Electronic photo sharing method and system for same
CN105306249A (en) * 2015-07-10 2016-02-03 深圳市美贝壳科技有限公司 Method for displaying uploading status in real time in process of uploading pictures to Cloud
CN106937012A (en) * 2015-12-31 2017-07-07 安富国 A kind of client timing uploading pictures realize the live method of online picture
CN106960172A (en) * 2016-01-08 2017-07-18 中兴通讯股份有限公司 Personal identification processing method, apparatus and system
WO2018040910A1 (en) * 2016-09-02 2018-03-08 丰唐物联技术（深圳）有限公司 Live broadcast method and system
CN108696724A (en) * 2018-05-29 2018-10-23 哈尔滨市舍科技有限公司 The live broadcast system of high definition photo can be obtained immediately

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
"Cloud Photography";Robert E. Cox;《Taylor & Francis Group》;20100708;全文 *
"云摄影是什么？是怎么呈现的？";杭州喔影网络科技有限公司;《https://wenku.baidu.com/view/a2ea31bbb9f67c1cfad6195f312b3169a451ea05.html》;20180929;全文 *
"云摄影直播让您的活动照片实时分享";杭州喔影网络科技有限公司;《百度文库》;20181015;全文 *
"云犀BOX Pro测评 云犀，随时随地畅享直播";陈婷睿;《数码影像时代》;20181231;全文 *

Also Published As

Publication number Publication date
CN110191170A (en) 2019-08-30

Similar Documents

Publication Publication Date Title
US11017018B2 (en) Systems and methods of building and using an image catalog
CN110188216B (en) Photo live broadcasting system with character recognition and method thereof
US10067652B2 (en) Providing access to a cloud based content management system on a mobile device
CN110166790B (en) Live photo broadcasting system with face recognition function and method thereof
CN106231368A (en) Main broadcaster's class interaction platform stage property rendering method and device, client
TW200406122A (en) System and method for remote controlled photography
US20150213577A1 (en) Zoom images with panoramic image capture
US20100153864A1 (en) Adaptable transfer and publication of digital media
EP4080507A1 (en) Method and apparatus for editing object, electronic device and storage medium
CN110515908B (en) Photo live broadcasting system and method thereof
EP2146294A1 (en) Mthod and apparatus for managing media
CN110121076B (en) Live photo broadcasting system and method
US8635270B2 (en) Thread mechanism for media and metadata upload
US20120307078A1 (en) Automatic sharing and replacement of content based on network connectivity
CN110191170B (en) Live photo broadcasting system with face recognition function and method thereof
US10264324B2 (en) System and method for group-based media composition
CN104137101B (en) Method, apparatus for managing media file and computer program product
CN110113629B (en) Photo live broadcasting system and method thereof
US11836411B2 (en) Method and system for view sharing of digital files
CN112463998B (en) Album resource processing method and device, electronic equipment and storage medium
CN111885296A (en) Dynamic processing method of visual data and electronic equipment
US20240282342A1 (en) Time-lapse imaging systems and methods
KR101963298B1 (en) Smart Apparatus for having Image management application and Image managing method thereof
CN119094863A (en) Content publishing method, content interaction method, system, device, equipment, storage medium and program product
CN116107982A (en) Method and device for processing and using file data

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant