2020 IEEE International Conference on Big Data (Big Data), 2020
Massive gatherings require hosting authorities to plan and deploy extensive arrangements to facil... more Massive gatherings require hosting authorities to plan and deploy extensive arrangements to facilitate attendees while considering crowd safety the core objective. The task becomes more challenging when crowd is diverse in terms of language, culture, ethics and age-group. Hajj is an annual event where more than 2 million pilgrims from all over the world, gather in Makkah Al-Mukarramah to perform a series of spatio-temporal rituals. To plan and execute the event, the management needs to understand the behavior of both individuals and groups of pilgrims belonging to different nationalities. In this paper, we proposed a big data framework that collects mobile sensory data from all pilgrims by providing them location-based context-aware services through a mobile application. We utilize the collected data to study pedestrians’ flow rate, mobility patterns for individuals and groups and their behaviour and preferences during movement. The extracted information can be analyzed to propose solutions to crowd related challenges, including mobility schedules, crowd modelling and simulation and emergency evacuation plans.
2020 IEEE International Conference on Big Data (Big Data), 2020
Reduced cost and increased proliferation of sensors has resulted in the generation of a large amo... more Reduced cost and increased proliferation of sensors has resulted in the generation of a large amount of data. To make use of this data effectively, efficient techniques for collecting, storing and managing data are needed. In this paper, we present a health big data indexing technique that allows for the efficient storage, querying and management of tele-rehabilitation related big data collected via health sensors connected to client machines accessing web-based e-Health frameworks. Our novel scheme is based on indexing of rehabilitation data based on the human body joint model. We further index the data based on other parameters that may be of interest to researchers such as ethnicity and geographical location. We have described all components of the system in brief.
As human-centered interactive technologies, serious games are getting popularity in a variety of ... more As human-centered interactive technologies, serious games are getting popularity in a variety of fields such as training simulations, health, national defense, and education. To build the best learning experience when designing a serious game, a system requires the integration of accurate spatio-temporal information. Also, there is an increasing need for intelligent medical technologies, which enable patients to live independently at home. This paper introduces a novel e-Health framework that leverages GIS-based serious games for people with disabilities. This framework consists of a spatio-temporal map-browsing environment augmented with our newly introduced multi-sensory natural user interface. We propose a comprehensive architecture that includes a sensory data manager, a storage layer, an information processing and computational intelligence layer, and a user interface layer. Detailed mathematical modeling as well as mapping methodology to convert different therapy-based hand-ge...
Proceedings of the 23rd ACM international conference on Multimedia, 2015
This paper presents a system that enables efficient and scalable real-time user and vehicle disco... more This paper presents a system that enables efficient and scalable real-time user and vehicle discovery using textual, audio and video mechanisms. The system allows users to group together for shared intra-city transportation with the aid of multimedia that helps individuals to 1) find community of common interest (CoCI), 2) locate individual users in a large crowd and 3) locate vehicles for mobility in an efficient and cost effective manner. The system is a pilot project and will be deployed during Hajj 2015 when over three million pilgrims from all over the world visit Makkah, Saudi Arabia.
Proceedings of the 3rd ACM conference on International conference on multimedia retrieval - ICMR '13, 2013
ABSTRACT In this paper, we present an interactive multimedia environment that can be used to effe... more ABSTRACT In this paper, we present an interactive multimedia environment that can be used to effectively complement the role of a therapist in the process of rehabilitation for disabled children. We use Microsoft Kinect 3D depth sensing camera with the online Second Life virtual world to record rehabilitation exercises performed by a physiotherapist or a disabled child. The exercise session can be played synchronously in Second Life. The physical activities of the users are synchronized with their virtual counterparts in the Second Life. The exercises can be recorded as well and made available for downloading to facilitate offline playback. A disabled child can follow the exercise at home in the absence of the therapist, since the system can provide visual guidance for performing the exercise in the right manner. Using the proposed system, parents at home can also assist the disabled child in performing therapy sessions in the absence of a therapist. Following the suggestions of therapists, the developed prototype can track several gestures of children who have mobility problems. Using a single Kinect device, we can capture high resolution joint movement of the body, without the need for any complicated hardware set up. The initial joint-based angular measurements show promising potential of our prototype to be deployed in real physiotherapy sessions.
Proceedings of the 23rd ACM international conference on Multimedia - MM '15, 2015
Aggregating interesting spatio-temporal events of daily life in a diary used to be favorite pasti... more Aggregating interesting spatio-temporal events of daily life in a diary used to be favorite pastime for many individuals. However, crescive use of social media through portable digital devices is replacing traditional diary writing. Thanks to ubiquity of smartphones, people can now add multiple media types in order to record joyful moments and events with a time line. In this paper, we propose a spatio-temporal multimedia authoring tool by leveraging the ubiquity of geo-tagged multimedia that represents activities of interest to the user and allowing users to aggregate the multimedia for generating a digital diary. The authoring tool allows users to aggregate one’s own spatial media with that of publicly available geo-tagged multimedia artifacts. The complex digital diary can then be saved into a big data repository for personal use as well as for sharing with a community of interest (COI). During the authoring process, the system allows a novel visualization technique of browsing clustered multiple points of interests (CMPOI) at a single GPS location, thereby exploring POIs in a multi-story building, shopping mall, etc. To facilitate efficient and user friendly discovery of CMPOIs, the authoring environment also supports spatio-temporal multimedia queries such as range and KNN (K nearest neighbor) queries from the big data environment. We plan to incorporate this multimedia authoring tool with our existing large scale multimedia supported crowdsourcing environment that is envisioned to support millions of pilgrims during the Hajj 2015 event.
As human-centered interactive technologies, serious games are getting popularity in a variety of ... more As human-centered interactive technologies, serious games are getting popularity in a variety of fields such as training simulations, health, national defense, and education. To build the best learning experience when designing a serious game, a system requires the integration of accurate spatio-temporal information. Also, there is an increasing need for intelligent medical technologies, which enable patients to live independently at home. This paper introduces a novel e-Health framework that leverages GIS-based serious games for people with disabilities. This framework consists of a spatio-temporal map-browsing environment augmented with our newly introduced multi-sensory natural user interface. We propose a comprehensive architecture that includes a sensory data manager, a storage layer, an information processing and computational intelligence layer, and a user interface layer. Detailed mathematical mod-eling as well as mapping methodology to convert different therapy-based hand-gestures into navigational movements within the serious game environment are also presented. Moreover, an Intelligent Game Recommender has been developed for generating optimized navigational routes based on therapeutic gestures. Those routes are tailored to the patient preferences and capabilities. Motion data is stored in a repository throughout the different sessions for offline replaying and advanced analysis; and different indicators are displayed in a live manner. To the best of our knowledge, this is the first GIS-based game recommender framework for online physical therapy. The prototype has been deployed to a disability center. The obtained results and feedback from therapists and patients are encouraging.
Proceedings of the 23rd ACM international conference on Multimedia - MM '15, 2015
Traditional routing algorithms for calculating the fastest or shortest path become ineffective or... more Traditional routing algorithms for calculating the fastest or shortest path become ineffective or difficult to use when both source and destination are dynamic or unknown. To solve the problem, we propose a novel semantic routing system that leverages geo-tagged rich crowdsourced multimedia information such as images, audio, video and text to add semantics to the conventional routing. Our proposed system includes a Semantic Multimedia Routing Algorithm (SMRA) that uses an indexed spatial big data environment to answer multimedia spatiotemporal queries in real-time. The results are customized to the users’ smartphone bandwidth and resolution requirements. The system has been designed to be able to handle a very large number of multimedia spatio-temporal requests at any given moment. A proof of concept of the system will be demonstrated through two scenarios. These are 1) multimedia enhanced routing and 2) finding lost individuals in a large crowd using multimedia. We plan to test the system’s performance and usability during Hajj 2015, where over four million pilgrims from all over the world gather to perform their rituals.
2020 IEEE International Conference on Big Data (Big Data), 2020
Massive gatherings require hosting authorities to plan and deploy extensive arrangements to facil... more Massive gatherings require hosting authorities to plan and deploy extensive arrangements to facilitate attendees while considering crowd safety the core objective. The task becomes more challenging when crowd is diverse in terms of language, culture, ethics and age-group. Hajj is an annual event where more than 2 million pilgrims from all over the world, gather in Makkah Al-Mukarramah to perform a series of spatio-temporal rituals. To plan and execute the event, the management needs to understand the behavior of both individuals and groups of pilgrims belonging to different nationalities. In this paper, we proposed a big data framework that collects mobile sensory data from all pilgrims by providing them location-based context-aware services through a mobile application. We utilize the collected data to study pedestrians’ flow rate, mobility patterns for individuals and groups and their behaviour and preferences during movement. The extracted information can be analyzed to propose solutions to crowd related challenges, including mobility schedules, crowd modelling and simulation and emergency evacuation plans.
2020 IEEE International Conference on Big Data (Big Data), 2020
Reduced cost and increased proliferation of sensors has resulted in the generation of a large amo... more Reduced cost and increased proliferation of sensors has resulted in the generation of a large amount of data. To make use of this data effectively, efficient techniques for collecting, storing and managing data are needed. In this paper, we present a health big data indexing technique that allows for the efficient storage, querying and management of tele-rehabilitation related big data collected via health sensors connected to client machines accessing web-based e-Health frameworks. Our novel scheme is based on indexing of rehabilitation data based on the human body joint model. We further index the data based on other parameters that may be of interest to researchers such as ethnicity and geographical location. We have described all components of the system in brief.
As human-centered interactive technologies, serious games are getting popularity in a variety of ... more As human-centered interactive technologies, serious games are getting popularity in a variety of fields such as training simulations, health, national defense, and education. To build the best learning experience when designing a serious game, a system requires the integration of accurate spatio-temporal information. Also, there is an increasing need for intelligent medical technologies, which enable patients to live independently at home. This paper introduces a novel e-Health framework that leverages GIS-based serious games for people with disabilities. This framework consists of a spatio-temporal map-browsing environment augmented with our newly introduced multi-sensory natural user interface. We propose a comprehensive architecture that includes a sensory data manager, a storage layer, an information processing and computational intelligence layer, and a user interface layer. Detailed mathematical modeling as well as mapping methodology to convert different therapy-based hand-ge...
Proceedings of the 23rd ACM international conference on Multimedia, 2015
This paper presents a system that enables efficient and scalable real-time user and vehicle disco... more This paper presents a system that enables efficient and scalable real-time user and vehicle discovery using textual, audio and video mechanisms. The system allows users to group together for shared intra-city transportation with the aid of multimedia that helps individuals to 1) find community of common interest (CoCI), 2) locate individual users in a large crowd and 3) locate vehicles for mobility in an efficient and cost effective manner. The system is a pilot project and will be deployed during Hajj 2015 when over three million pilgrims from all over the world visit Makkah, Saudi Arabia.
Proceedings of the 3rd ACM conference on International conference on multimedia retrieval - ICMR '13, 2013
ABSTRACT In this paper, we present an interactive multimedia environment that can be used to effe... more ABSTRACT In this paper, we present an interactive multimedia environment that can be used to effectively complement the role of a therapist in the process of rehabilitation for disabled children. We use Microsoft Kinect 3D depth sensing camera with the online Second Life virtual world to record rehabilitation exercises performed by a physiotherapist or a disabled child. The exercise session can be played synchronously in Second Life. The physical activities of the users are synchronized with their virtual counterparts in the Second Life. The exercises can be recorded as well and made available for downloading to facilitate offline playback. A disabled child can follow the exercise at home in the absence of the therapist, since the system can provide visual guidance for performing the exercise in the right manner. Using the proposed system, parents at home can also assist the disabled child in performing therapy sessions in the absence of a therapist. Following the suggestions of therapists, the developed prototype can track several gestures of children who have mobility problems. Using a single Kinect device, we can capture high resolution joint movement of the body, without the need for any complicated hardware set up. The initial joint-based angular measurements show promising potential of our prototype to be deployed in real physiotherapy sessions.
Proceedings of the 23rd ACM international conference on Multimedia - MM '15, 2015
Aggregating interesting spatio-temporal events of daily life in a diary used to be favorite pasti... more Aggregating interesting spatio-temporal events of daily life in a diary used to be favorite pastime for many individuals. However, crescive use of social media through portable digital devices is replacing traditional diary writing. Thanks to ubiquity of smartphones, people can now add multiple media types in order to record joyful moments and events with a time line. In this paper, we propose a spatio-temporal multimedia authoring tool by leveraging the ubiquity of geo-tagged multimedia that represents activities of interest to the user and allowing users to aggregate the multimedia for generating a digital diary. The authoring tool allows users to aggregate one’s own spatial media with that of publicly available geo-tagged multimedia artifacts. The complex digital diary can then be saved into a big data repository for personal use as well as for sharing with a community of interest (COI). During the authoring process, the system allows a novel visualization technique of browsing clustered multiple points of interests (CMPOI) at a single GPS location, thereby exploring POIs in a multi-story building, shopping mall, etc. To facilitate efficient and user friendly discovery of CMPOIs, the authoring environment also supports spatio-temporal multimedia queries such as range and KNN (K nearest neighbor) queries from the big data environment. We plan to incorporate this multimedia authoring tool with our existing large scale multimedia supported crowdsourcing environment that is envisioned to support millions of pilgrims during the Hajj 2015 event.
As human-centered interactive technologies, serious games are getting popularity in a variety of ... more As human-centered interactive technologies, serious games are getting popularity in a variety of fields such as training simulations, health, national defense, and education. To build the best learning experience when designing a serious game, a system requires the integration of accurate spatio-temporal information. Also, there is an increasing need for intelligent medical technologies, which enable patients to live independently at home. This paper introduces a novel e-Health framework that leverages GIS-based serious games for people with disabilities. This framework consists of a spatio-temporal map-browsing environment augmented with our newly introduced multi-sensory natural user interface. We propose a comprehensive architecture that includes a sensory data manager, a storage layer, an information processing and computational intelligence layer, and a user interface layer. Detailed mathematical mod-eling as well as mapping methodology to convert different therapy-based hand-gestures into navigational movements within the serious game environment are also presented. Moreover, an Intelligent Game Recommender has been developed for generating optimized navigational routes based on therapeutic gestures. Those routes are tailored to the patient preferences and capabilities. Motion data is stored in a repository throughout the different sessions for offline replaying and advanced analysis; and different indicators are displayed in a live manner. To the best of our knowledge, this is the first GIS-based game recommender framework for online physical therapy. The prototype has been deployed to a disability center. The obtained results and feedback from therapists and patients are encouraging.
Proceedings of the 23rd ACM international conference on Multimedia - MM '15, 2015
Traditional routing algorithms for calculating the fastest or shortest path become ineffective or... more Traditional routing algorithms for calculating the fastest or shortest path become ineffective or difficult to use when both source and destination are dynamic or unknown. To solve the problem, we propose a novel semantic routing system that leverages geo-tagged rich crowdsourced multimedia information such as images, audio, video and text to add semantics to the conventional routing. Our proposed system includes a Semantic Multimedia Routing Algorithm (SMRA) that uses an indexed spatial big data environment to answer multimedia spatiotemporal queries in real-time. The results are customized to the users’ smartphone bandwidth and resolution requirements. The system has been designed to be able to handle a very large number of multimedia spatio-temporal requests at any given moment. A proof of concept of the system will be demonstrated through two scenarios. These are 1) multimedia enhanced routing and 2) finding lost individuals in a large crowd using multimedia. We plan to test the system’s performance and usability during Hajj 2015, where over four million pilgrims from all over the world gather to perform their rituals.
Uploads
leverages geo-tagged rich crowdsourced multimedia information such as images, audio, video and text to add semantics to the conventional routing. Our proposed system includes a Semantic Multimedia Routing Algorithm (SMRA) that uses an indexed spatial big data environment to answer multimedia spatiotemporal
queries in real-time. The results are customized to the users’ smartphone bandwidth and resolution requirements. The system has been designed to be able to handle a very large number of multimedia spatio-temporal requests at any given moment. A proof of concept of the system will be demonstrated through two scenarios. These are 1) multimedia enhanced routing and 2) finding lost individuals in a large crowd using multimedia. We plan to test the system’s performance and usability during
Hajj 2015, where over four million pilgrims from all over the world gather to perform their rituals.
leverages geo-tagged rich crowdsourced multimedia information such as images, audio, video and text to add semantics to the conventional routing. Our proposed system includes a Semantic Multimedia Routing Algorithm (SMRA) that uses an indexed spatial big data environment to answer multimedia spatiotemporal
queries in real-time. The results are customized to the users’ smartphone bandwidth and resolution requirements. The system has been designed to be able to handle a very large number of multimedia spatio-temporal requests at any given moment. A proof of concept of the system will be demonstrated through two scenarios. These are 1) multimedia enhanced routing and 2) finding lost individuals in a large crowd using multimedia. We plan to test the system’s performance and usability during
Hajj 2015, where over four million pilgrims from all over the world gather to perform their rituals.