[go: up one dir, main page]

 
 
Sign in to use this feature.

Years

Between: -

Subjects

remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline

Journals

remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline

Article Types

Countries / Regions

remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline

Search Results (989)

Search Parameters:
Keywords = mobile agent

Order results
Result details
Results per page
Select all
Export citation of selected articles as:
22 pages, 3381 KiB  
Article
Autonomous Generation of a Public Transportation Network by an Agent-Based Model: Mutual Enrichment with Knowledge Graphs for Sustainable Urban Mobility
by Flann Chambers, Giovanna Di Marzo Serugendo and Christophe Cruz
Sustainability 2024, 16(20), 8907; https://doi.org/10.3390/su16208907 (registering DOI) - 14 Oct 2024
Viewed by 293
Abstract
Sound planning for urban mobility is a key facet of securing a sustainable future for our urban systems, and requires the careful and comprehensive assessment of its components, such as the status of the cities’ public transportation network, and how urban planners should [...] Read more.
Sound planning for urban mobility is a key facet of securing a sustainable future for our urban systems, and requires the careful and comprehensive assessment of its components, such as the status of the cities’ public transportation network, and how urban planners should invest in developing it. We use agent-based modelling, a tried and true method for such endeavours, for studying the history, planned future works and possible evolution of the tram line network in the Greater Geneva region. We couple these models with knowledge graphs, in a way that both are able to mutually enrich each other. Results show that the information organisation powers of knowledge graphs are highly relevant for effortlessly recounting past events and designing scenarios to be directly incorporated inside the agent-based model. The model features all 5 tram lines from the current real-world network, servicing a total of 15 communes. In turn, the model is capable of replaying past events, predicting future developments and exploring user-defined scenarios. It also harnesses its self-organisation properties to autonomously reconstruct an artificial public transportation network for the region based on two different initial networks, servicing up to 29 communes depending on the scenario. The data gathered from the simulation is effortlessly imported back into the initial knowledge graphs. The artificial networks closely resemble their real-world counterparts and demonstrate the predictive and prescriptive powers of our agent-based model. They constitute valuable assets towards a comprehensive assessment of urban mobility systems, compelling progress for the agent-based modelling field, and a convincing demonstration of its technical capabilities. Full article
Show Figures

Figure 1

Figure 1
<p>Map of the Geneva public transportation network’s tram lines. Present date and future segments are represented according to the event table devised in this study (see <a href="#sustainability-16-08907-t001" class="html-table">Table 1</a>). Tram line 13 (towards Ferney-Voltaire), tram line 15 extension to Saint-Julien from ZIPLO, and tram 17 extension to Le Perrier from Annemasse center, are planned works as of 2024, and are not yet established.</p>
Full article ">Figure 2
<p>Methodology workflow for gathering input data, building the knowledge graph and agent-based model evolution rules, producing simulation output data, then visualising and analysing it, and finally validating the model. When relevant, elements of the workflow are indexed with their dedicated section in this paper, denoted as (<b>s4.1</b>) for <a href="#sec4dot1-sustainability-16-08907" class="html-sec">Section 4.1</a>, for instance.</p>
Full article ">Figure 3
<p>Organisation of elements inside the ontology. White boxes show elements that are contained in the ontology used to build the initial knowledge graphs, which then enrich the agent-based model. Blue boxes show elements that are imported from the agent-based simulations, which then enrich the original knowledge graph.</p>
Full article ">Figure 4
<p>Tram network map for simulation 1, with the initial network obtained from the event table on <a href="#sustainability-16-08907-t001" class="html-table">Table 1</a> (real-world data and current situation), and prediction mode enabled for the future timelines.</p>
Full article ">Figure 5
<p>Initial knowledge graph created from the event table on <a href="#sustainability-16-08907-t001" class="html-table">Table 1</a> (<b>left</b>), used as input for the agent-based model, and nodes generated from the simulation outputs (<b>right</b>).</p>
Full article ">Figure 6
<p>Tram network map for simulation 2: fully artificial network obtained from a small loop in the city center of Geneva (in dark red).</p>
Full article ">Figure 7
<p>Tram network map for simulation 3: fully artificial network obtained from the initial tram line 12 extent (in dark red).</p>
Full article ">Figure 8
<p>Knowledge graph created from the model outputs during simulation 2: transportation network artificially generated by the model based on a small loop near the city center.</p>
Full article ">Figure 9
<p>Knowledge graph created from the model outputs during simulation 3: transportation network artificially generated by the model based on the initial tram line 12 extent.</p>
Full article ">
12 pages, 2706 KiB  
Article
Chromium Immobilization as Cr-Spinel by Regulation of Fe(II) and Fe(III) Concentrations
by Tianci Hua, Yanzhang Li, Bingxu Hou, Yimei Du, Anhuai Lu and Yan Li
Minerals 2024, 14(10), 1024; https://doi.org/10.3390/min14101024 - 13 Oct 2024
Viewed by 379
Abstract
The complex environmental conditions at Cr-contaminated sites, characterized by uneven ion distribution, oxidants competition, and limited solid-phase mobility, lead to inadequate mixing of Fe-based reducing agents with Cr, posing significant challenges to the effectiveness of Cr remediation through Cr-spinel precipitation. This study investigates [...] Read more.
The complex environmental conditions at Cr-contaminated sites, characterized by uneven ion distribution, oxidants competition, and limited solid-phase mobility, lead to inadequate mixing of Fe-based reducing agents with Cr, posing significant challenges to the effectiveness of Cr remediation through Cr-spinel precipitation. This study investigates the distinct roles of Fe(II), Fe(III), and Cr(III) in Cr-spinel crystallization under ambient temperature and pressure. X-ray diffraction, scanning electron microscopy, transmission electron microscopy, X-ray absorption near-edge structure spectroscopy, and Mössbauer spectroscopy were employed to elucidate the phase composition, microstructure, and ion coordination within the precipitates. Our findings indicate that Fe(II) acts as a catalyst in the formation of the spinel phase, occupying octahedral sites within the spinel structure. Under the catalytic influence of Fe(II), Fe(III) transitions into the spinel phase, occupying both the tetrahedral and the remaining octahedral sites. Meanwhile, Cr(III), due to its high octahedral site preference energy, preferentially occupies the octahedral sites. When Fe(II) or Fe(III) is present but does not meet the ideal stoichiometric ratio, a deficiency in Fe(II) leads to low yield and poor crystallinity of Cr-spinel, whereas a deficiency in Fe(III) can completely inhibit its formation. Conversely, when either Fe(II) or Fe(III) is in excess, the formation of Cr-spinel remains feasible. Furthermore, metastable Cr phases can be transformed into stable Cr-spinel by adjusting the Fe(II)/Fe(III)/Cr(III) ratio. These results highlight the broad range of conditions under which Cr-spinel mineralization can occur in environmental settings, enhancing our understanding of the mechanisms driving Cr-spinel formation in Cr-contaminated sites treated with Fe-based reducing agents. This research provides critical insights for optimizing Cr remediation strategies. Full article
(This article belongs to the Section Environmental Mineralogy and Biogeochemistry)
Show Figures

Figure 1

Figure 1
<p>Synthesis of Cr-spinel with Fe(II) at non-ideal stoichiometric ratios. (<b>a</b>) Comparison of the reduction processes of Fe(III) and Cr(III) co-precipitate by <span class="html-italic">S.</span> MR-1. (<b>b</b>) XRD patterns of Fe(II) precipitate, co-precipitate of Fe(III) and Cr(III), reduction of Fe(III) and Cr(III) co-precipitate by <span class="html-italic">S.</span> MR-1, and the co-precipitation of Fe(II), Fe(III), and Cr(III) at stoichiometric ratios of 2:1.5:0.5 and 0.5:1.5:0.5, respectively. The symbols ♥ and ♦ represent spinel and goethite, respectively.</p>
Full article ">Figure 2
<p>XRD patterns of Fe(III) precipitate, co-precipitate of Fe(II) and Cr(III), the oxidation of Fe(II) and Cr(III) co-precipitate by O<sub>2</sub>, and the co-precipitation of Fe(II), Fe(III), and Cr(III) at stoichiometric ratios of 1:2:1 and 1:0.5:1, respectively. The symbols ♥ and ♦ represent spinel and goethite, respectively.</p>
Full article ">Figure 3
<p>XRD patterns of Cr(III) precipitate, co-precipitate of Fe(II) and Fe(III), and the co-precipitation of Fe(II), Fe(III), and Cr(III) at stoichiometric ratios of 1:1.5:0.25 and 1:1.5:2, respectively. The symbols ♥ and ♦ represent spinel and goethite, respectively.</p>
Full article ">Figure 4
<p>XRD patterns of precipitates formed from various mixing sequences of ion precipitates. The symbols ♥ and ♦ represent spinel and goethite, respectively.</p>
Full article ">Figure 5
<p>SEM-EDS and TEM patterns of (<b>a</b>) the mixed precipitate of Fe(III) and Cr(III) co-precipitate with Fe(II) precipitate, (<b>b</b>) the mixed precipitate of Fe(II) and Cr(III) co-precipitate with Fe(III) precipitate, and (<b>c</b>) the mixed precipitate of Fe(II) and Fe(III) co-precipitate with Cr(III) precipitate. The red plus sign indicates the detection position of EDS.</p>
Full article ">Figure 6
<p>Cr K-edge XANES of the precipitates.</p>
Full article ">Figure 7
<p>Mössbauer spectrum analysis of the mixed precipitate of Fe(II) and Cr(III) co-precipitate with Fe(III) precipitate.</p>
Full article ">
17 pages, 1521 KiB  
Article
Investigating the Interactive Effect of Arbuscular Mycorrhizal Fungi and Different Chelating Agents (EDTA and DTPA) with Different Plant Species on Phytoremediation of Contaminated Soil
by Saud S. Aloud, Khaled D. Alotaibi, Khalid F. Almutairi, Fahad N. Albarakah, Fahad Alotaibi and Ibrahim A. Ahmed
Sustainability 2024, 16(20), 8820; https://doi.org/10.3390/su16208820 (registering DOI) - 11 Oct 2024
Viewed by 464
Abstract
Heavy metal (HM) contamination in soil poses a severe environmental threat, jeopardizing ecosystem health and potentially entering the food chain through plant uptake. Phytoremediation, a bioremediation technique utilizing plants to remove or immobilize contaminants, offers a sustainable and eco-friendly solution for HM remediation. [...] Read more.
Heavy metal (HM) contamination in soil poses a severe environmental threat, jeopardizing ecosystem health and potentially entering the food chain through plant uptake. Phytoremediation, a bioremediation technique utilizing plants to remove or immobilize contaminants, offers a sustainable and eco-friendly solution for HM remediation. This study investigated the interactive effects of arbuscular mycorrhizal fungi (AMF) and chelating agents (EDTA and DTPA) on the growth of maize (Zea mays L.) and alfalfa (Medicago sativa L.) cultivated in metal-contaminated soil and their impact on HM uptake by these plants. The findings revealed that AMF and chelating agents have complex interactive effects on plant growth and metal accumulation. Maize (Zea mays L.) shoot dry matter increased with AMF and chelating agents at lower concentrations. Both plants generally showed a significant (p ≤ 0.05) increase in shoot dry matter with amendments, with AMF × EDTA (10 mmol/kg) being the most effective for alfalfa. DTPA and EDTA generally reduced the DTPA-extractable metals in soil, suggesting potential for metal removal. However, the effects of AMF on metal availability were variable. Metal concentrations in maize (Zea mays L.) shoots increased with increasing DTPA and EDTA concentrations, while the effects of AMF were more complex. The alfalfa shoot metal content showed varied responses, with EDTA (5 mmol/kg) effectively reducing the metal uptake. In general, treatments involving chelating agents (DTPA and EDTA) tend to result in higher bioaccumulation factor (BF) values compared to the non-treated controls for most HMs in both plant species. Mycorrhizal fungi (AMF) treatment alone or in combination with chelating agents also showed that varied effects on HM uptake in both the alfalfa and maize treatments with chelating agents, especially at higher concentrations, generally promoted the greater translocation of HMs in both plant species. Both alfalfa and maize responded differently to treatments, with some treatments showing higher translocation factor (TF) values for certain HMs in one species compared to the other. Mycorrhizal fungi (AMF) treatment alone or in combination with chelating agents also showed varied effects on HM uptake and translocation in both alfalfa and maize. Further research is required to optimize remediation strategies that balance plant health and metal mobilization. Full article
(This article belongs to the Special Issue Soil Pollution, Soil Ecology and Sustainable Land Use)
Show Figures

Figure 1

Figure 1
<p>Shoot dry matter (g plant<sup>−1</sup>). (<b>a</b>) Represents the shoot DM of <span class="html-italic">Zea mays</span> L. and (<b>b</b>) represents the shoot DM of alfalfa (<span class="html-italic">Medicago sativa</span> L.) as affected by the incorporation of amendments into the soil. The means with the same letter are not significantly different from each other according to the LSD test (<span class="html-italic">p</span> &lt; 0.05).</p>
Full article ">Figure 2
<p>DTPA-extractable HM contents in contaminated soils. (<b>a</b>) Represents HMs of Co, Cr, and Ni; (<b>b</b>) represents HMs of Cu, Fe, and Mn; and (<b>c</b>) represents HMs of Cd, Pb, and Zn, all in (mg kg<sup>−1</sup>). The means with the same letter are not significantly different from each other according to the LSD test (<span class="html-italic">p</span> &lt; 0.05).</p>
Full article ">Figure 3
<p>Total HM content in the <span class="html-italic">Zea mays</span> L. shoots. (<b>a</b>) Represents the total HMs of Co and Cr; (<b>b</b>) represents the total HMs of Cu and Mn; and (<b>c</b>) represents the total HMs of Cd, Ni, Pb, and Zn, all in (mg kg<sup>−1</sup>). The means with the same letter are not significantly different from each other according to the LSD test (<span class="html-italic">p</span> &lt; 0.05).</p>
Full article ">Figure 4
<p>Total HM content in the <span class="html-italic">Medicago sativa</span> L. shoots. (<b>a</b>) Represents the total HMs of Cd, Cr, Ni, and Zn; (<b>b</b>) represents the total HMs of Co and Pb; and (<b>c</b>) represents the total HMs of Cu and Mn, all in (mg kg<sup>−1</sup>). The means with the same letter are not significantly different from each other according to the LSD test (<span class="html-italic">p</span> &lt; 0.05).</p>
Full article ">
18 pages, 3643 KiB  
Article
MMD-TSC: An Adaptive Multi-Objective Traffic Signal Control for Energy Saving with Traffic Efficiency
by Yuqi Zhang, Yingying Zhou, Beilei Wang and Jie Song
Energies 2024, 17(19), 5015; https://doi.org/10.3390/en17195015 - 9 Oct 2024
Viewed by 390
Abstract
Reducing traffic energy consumption is crucial for smart cities, and vehicle carbon emissions are a key energy indicator. Traffic signal control (TSC) is a useful method because it can affect the energy consumption of vehicles on the road by controlling the stop-and-go of [...] Read more.
Reducing traffic energy consumption is crucial for smart cities, and vehicle carbon emissions are a key energy indicator. Traffic signal control (TSC) is a useful method because it can affect the energy consumption of vehicles on the road by controlling the stop-and-go of vehicles at traffic intersections. However, setting traffic signals to reduce energy consumption will affect traffic efficiency and this is not in line with traffic management objectives. Current studies adopt multi-objective optimization methods with high traffic efficiency and low carbon emissions to solve this problem. However, most methods use static weights, which cannot adapt to complex and dynamic traffic states, resulting in non-optimal performance. Current energy indicators for urban transportation often fail to consider passenger fairness. This fairness is significant because the purpose of urban transportation is to serve people’s mobility needs not vehicles. Therefore, this paper proposes Multi-objective Adaptive Meta-DQN TSC (MMD-TSC), which introduces a dynamic weight adaptation mechanism to simultaneously optimize traffic efficiency and energy saving, and incorporates the per capita carbon emissions as the energy indicator. Firstly, this paper integrates traffic state data such as vehicle positions, velocities, vehicle types, and the number of passengers and incorporates fairness into the energy indicators, using per capita carbon emissions as the target for reducing energy consumption. Then, it proposes MMD-TSC with dynamic weights between energy consumption and traffic efficiency as reward functions. The MMD-TSC model includes two agents, the TSC agent and the weight agent, which are responsible for traffic signal adjustment and weight calculation, respectively. The weights are calculated by a function of traffic states. Finally, the paper describes the design of the MMD-TSC model learning algorithm and uses a SUMO (Simulation of Urban Mobility) v.1.20.0 for traffic simulation. The results show that in non-highly congested traffic states, the MMD-TSC model has higher traffic efficiency and lower energy consumption compared to static multi-objective TSC models and single-objective TSC models, and can adaptively achieve traffic management objectives. Compared with using vehicle average carbon emissions as the energy consumption indicator, using per capita carbon emissions achieves Pareto improvements in traffic efficiency and energy consumption indicators. The energy utilization efficiency of the MMD-TSC model is improved by 35% compared to the fixed-time TSC. Full article
Show Figures

Figure 1

Figure 1
<p>Overview of MDD-TSC.</p>
Full article ">Figure 2
<p>Intersection layout and signal phase settings. (<b>a</b>) The intersection layout with through and left-turn lanes: One left-turn lane, two through lanes, and one right-turn lane. (<b>b</b>) Four signal phases: Phase 1 (NS and SN through traffic), Phase 2 (NW and SE left-turn traffic), Phase 3 (WE and EW left-turn traffic), and Phase 4 (WN and ES through traffic).</p>
Full article ">Figure 3
<p>MDD-TSC model diagram. The model consists of two agents, the inner loop is the TSC agent and the outer loop is the weight agent. Two agents collaborate to calculate actions and rewards, and share memory information.</p>
Full article ">Figure 4
<p>Comparison of sustainability indicators among different TSC models over time. (<b>a</b>) Relationship between per capita carbon emissions and simulation time for each model. (<b>b</b>) Relationship between cumulative carbon emissions and simulation time for each model.</p>
Full article ">Figure 5
<p>Comparison of traffic indicators among different TSC models over time. (<b>a</b>) Relationship between average queue length and simulation time for each model. (<b>b</b>) Relationship between average vehicle waiting time and simulation time for each model.</p>
Full article ">Figure 6
<p>Heatmaps of the influence of different spatial locations on weights at three time periods: (<b>a</b>) Time period 1, (<b>b</b>) Time period 2, and (<b>c</b>) Time period 3. The influence is standardized to a range of 0–1, and the larger the value, the greater the degree of influence. Yellow has the greatest impact here.</p>
Full article ">Figure 7
<p>The degree of influence of different locations in the intersection on the dynamic weights is standardized to a range of 0–1. Larger values indicate a greater degree of influence. Yellow indicates the greatest influence. (<b>a</b>) A 3D plot shows the relationship between simulation time, queue length, and cumulative carbon emissions in a single graph. To provide a clearer view of the relationship between the two indicators and simulation time, (<b>b</b>,<b>c</b>) are line graphs showing the relationship between queue length, cumulative carbon emissions, and simulation time.</p>
Full article ">Figure 8
<p>Comparative analysis of energy consumption utilization among different TSC models. (<b>a</b>) Relationship between passed passengers per gasoline for each model. (<b>b</b>) Relationship between passed vehicles per gasoline for each model.</p>
Full article ">
33 pages, 10372 KiB  
Article
Adaptive Multi-Agent Reinforcement Learning for Optimizing Dynamic Electric Vehicle Charging Networks in Thailand
by Pitchaya Jamjuntr, Chanchai Techawatcharapaikul and Pannee Suanpang
World Electr. Veh. J. 2024, 15(10), 453; https://doi.org/10.3390/wevj15100453 - 6 Oct 2024
Viewed by 391
Abstract
The rapid growth of electric vehicles (EVs) necessitates efficient management of dynamic EV charging networks to optimize resource utilization and enhance service reliability. This paper explores the application of adaptive multi-agent reinforcement learning (MARL) to address the complexities of EV charging infrastructure in [...] Read more.
The rapid growth of electric vehicles (EVs) necessitates efficient management of dynamic EV charging networks to optimize resource utilization and enhance service reliability. This paper explores the application of adaptive multi-agent reinforcement learning (MARL) to address the complexities of EV charging infrastructure in Thailand. By employing MARL, multiple autonomous agents learn to optimize charging strategies based on real-time data by adapting to fluctuating demand and varying electricity prices. Building upon previous research that applied MARL to static network configurations, this study extends the application to dynamic and real-world scenarios, integrating real-time data to refine agent learning processes and also evaluating the effectiveness of adaptive MARL in maximizing rewards and improving operational efficiency compared to traditional methods. Experimental results indicate that MARL-based strategies increased efficiency by 20% and reduced energy costs by 15% relative to conventional algorithms. Key findings demonstrate the potential of extending MARL in transforming EV charging network management, highlighting its benefits for stakeholders, including EV owners, operators, and utility providers. This research contributes insights into advancing electric mobility and energy management in Thailand through innovative AI-driven approaches. The implications of this study include significant improvements in the reliability and cost-effectiveness of EV charging networks, fostering greater adoption of electric vehicles and supporting sustainable energy initiatives. Future research directions include enhancing MARL adaptability and scalability as well as integrating predictive analytics for proactive network optimization and sustainability. These advancements promise to further refine the efficacy of EV charging networks, ensuring that they meet the growing demands of Thailand’s evolving electric mobility landscape. Full article
Show Figures

Figure 1

Figure 1
<p>Thailand EV charging context.</p>
Full article ">Figure 2
<p>Multi-Agent reinforcement learning interaction.</p>
Full article ">Figure 3
<p>Importance of adaptability in MARL.</p>
Full article ">Figure 4
<p>Research framework.</p>
Full article ">Figure 5
<p>Learning algorithm: Deep Q-Learning (DQN) for EV charging network management.</p>
Full article ">Figure 6
<p>Adaptive multi-agent reinforcement learning workflow for dynamic EV charging networks.</p>
Full article ">Figure 7
<p>Comparative analysis of adaptive and non-adaptive MARL approaches.</p>
Full article ">Figure 8
<p>Average reward and convergence time.</p>
Full article ">Figure 9
<p>Exploration vs. exploitation trade-off.</p>
Full article ">Figure 10
<p>Average reward comparison between adaptive and non-adaptive MARL.</p>
Full article ">Figure 11
<p>Training rewards.</p>
Full article ">Figure 12
<p>Epsilon decay.</p>
Full article ">Figure 13
<p>Epsilon time.</p>
Full article ">Figure 14
<p>Final states.</p>
Full article ">Figure 15
<p>Dynamic EV charging network.</p>
Full article ">Figure 16
<p>Reward comparison per episode for different scenarios.</p>
Full article ">Figure 17
<p>Convergence time across scenarios.</p>
Full article ">Figure 18
<p>Exploration vs. exploitation analysis.</p>
Full article ">Figure 19
<p>Reward maximization over time.</p>
Full article ">Figure 20
<p>State variable evolution comparison.</p>
Full article ">Figure 21
<p>Computational efficiency.</p>
Full article ">
24 pages, 1966 KiB  
Article
A Study on the Production-Inventory Problem with Omni-Channel and Advance Sales Based on the Brand Owner’s Perspective
by Jialiang Pan, Chi-Jie Lu, Wei-Jen Chen, Kun-Shan Wu and Chih-Te Yang
Mathematics 2024, 12(19), 3122; https://doi.org/10.3390/math12193122 - 6 Oct 2024
Viewed by 314
Abstract
This study explores a supply chain product-inventory problem with advance sales under the omni-channel strategies (physical and online sales channels) based on the brand owner’s business model and develops corresponding models that have not been proposed in previous studies. In addition, because the [...] Read more.
This study explores a supply chain product-inventory problem with advance sales under the omni-channel strategies (physical and online sales channels) based on the brand owner’s business model and develops corresponding models that have not been proposed in previous studies. In addition, because the brand owner is a member of the supply chain, and has different handling methods for defective products or products returned by customers in various retail channels, defective products or returned products are included in the supply chain models to comply with actual operating conditions and fill the research gap in the handling of defective/returned products. Regarding the mathematical model’s development, we first clarify the definition of model parameters and relevant data collection, and then establish the production-inventory models with omni-channel strategies and advance sales. The primary objective is to determine the optimal production, delivery, and replenishment decisions of the manufacturer, physical agent, and online e-commerce company in order to maximize the joint total profits of the entire supply chain system. Further, this study takes the supply chain system of mobile game steering wheel products as an example, uses data consistent with the actual situation to demonstrate the optimal solutions of the models, and conducts sensitivity analysis for the proposed model. The findings reveal that increased demand shortens the replenishment cycle and raises order quantity and shipment frequency in the physical channel, similar to the online channel during normal sales. However, during the online pre-order period, higher demand reduces order quantity and cycle length but still increases shipment frequency. Rising ordering or fixed shipping costs lead to higher order quantity and cycle length in both channels, but variable shipping costs in the online channel reduce them. Market price increases boost order quantity and frequency in the online channel, while customer return rates significantly impact inventory decisions. Full article
(This article belongs to the Special Issue Advances in Modern Supply Chain Management and Information Technology)
Show Figures

Figure 1

Figure 1
<p>The entire supply chain system with different retail channels from the brand owner’s perspective.</p>
Full article ">Figure 2
<p>Inventory level of the physical channel retailer for a replenishment cycle.</p>
Full article ">Figure 3
<p>Inventory level of the e-commerce company for a replenishment cycle.</p>
Full article ">Figure 4
<p>Inventory levels of manufacturer for each key components and finished goods in a production cycle for different channels (<span class="html-italic">i</span> = <span class="html-italic">R</span> or <span class="html-italic">O</span>).</p>
Full article ">Figure 5
<p>Manufacturer’s cumulative inventory in a production cycle for different channels (<span class="html-italic">i</span> = <span class="html-italic">R</span> or <span class="html-italic">O</span>).</p>
Full article ">
20 pages, 1524 KiB  
Review
Fluorescence Polarization Assay for Infection Diagnostics: A Review
by Sergei A. Eremin, Liliya I. Mukhametova, Vadim B. Krylov and Nikolay E. Nifantiev
Molecules 2024, 29(19), 4712; https://doi.org/10.3390/molecules29194712 - 5 Oct 2024
Viewed by 611
Abstract
Rapid and specific diagnosis is necessary for both the treatment and prevention of infectious diseases. Bacteria and viruses that enter the bloodstream can trigger a strong immune response in infected animals and humans. The fluorescence polarization assay (FPA) is a rapid and accurate [...] Read more.
Rapid and specific diagnosis is necessary for both the treatment and prevention of infectious diseases. Bacteria and viruses that enter the bloodstream can trigger a strong immune response in infected animals and humans. The fluorescence polarization assay (FPA) is a rapid and accurate method for detecting specific antibodies in the blood that are produced in response to infection. One of the first examples of FPA is the non-competitive test for detecting brucellosis in animals, which was followed by the development of other protocols for detecting various infections. Fluorescently labeled polysaccharides (in the case of brucellosis and salmonellosis) or specific peptides (in the case of tuberculosis and salmonellosis, etc.) can be used as biorecognition elements for detecting infections. The availability of new laboratory equipment and mobile devices for fluorescence polarization measurements outside the laboratory has stimulated the development of new fluorescence polarization assays (FPAs) and the emergence of commercial kits on the market for the detection of brucellosis, tuberculosis, and equine infectious anemia viruses. It has been shown that, in addition to antibodies, the FPA method can detect both viruses and nucleic acids. The development of more specific and sensitive biomarkers is essential for the diagnosis of infections and therapy monitoring. This review summarizes studies published between 2003 and 2023 that focus on the detection of infections using FPA. Furthermore, it demonstrates the potential for using new biorecognition elements (e.g., aptamers, proteins, peptides) and the combined use of FPA with new technologies, such as PCR and CRISPR/Cas12a systems, for detecting various infectious agents. Full article
(This article belongs to the Topic Advances in Spectroscopic and Chromatographic Techniques)
Show Figures

Figure 1

Figure 1
<p>Principle of FP signal change.</p>
Full article ">Figure 2
<p>Targets used for diagnostics of infectious diseases.</p>
Full article ">Figure 3
<p>Biorecognition elements used in FPA for detection of infectious diseases.</p>
Full article ">Figure 4
<p>Scheme for detection of H5N3 viruses using fluorescently labeled Fab fragments of antibodies by the FPA method.</p>
Full article ">Figure 5
<p>A schematic representation of the FA assay based on CRISPR/Cas12 using a single-stranded DNA probe with a protein anchor [<a href="#B82-molecules-29-04712" class="html-bibr">82</a>].</p>
Full article ">Figure 6
<p>(<b>A</b>). Structure of the <span class="html-italic">Brucella</span> O-polysaccharide showing the M epitope. (<b>B</b>). Synthetic FITC-labelled biotracer used in diagnostic FPA tests for brucellosis detection.</p>
Full article ">
20 pages, 1379 KiB  
Article
Energy Efficiency Maximization for Multi-UAV-IRS-Assisted Marine Vehicle Systems
by Chaoyue Zhang, Bin Lin, Chao Li and Shuang Qi
J. Mar. Sci. Eng. 2024, 12(10), 1761; https://doi.org/10.3390/jmse12101761 - 4 Oct 2024
Viewed by 442
Abstract
Mobile edge computing is envisioned as a prospective technology for supporting time-sensitive and computation-intensive applications in marine vehicle systems. However, the offloading performance is highly impacted by the poor wireless channel. Recently, an Unmanned Aerial Vehicle (UAV) equipped with an Intelligent Reflecting Surface [...] Read more.
Mobile edge computing is envisioned as a prospective technology for supporting time-sensitive and computation-intensive applications in marine vehicle systems. However, the offloading performance is highly impacted by the poor wireless channel. Recently, an Unmanned Aerial Vehicle (UAV) equipped with an Intelligent Reflecting Surface (IRS), i.e., UIRS, has drawn attention due to its capability to control wireless signals so as to improve the data rate. In this paper, we consider a multi-UIRS-assisted marine vehicle system where UIRSs are deployed to assist in the computation offloading of Unmanned Surface Vehicles (USVs). To improve energy efficiency, the optimization problem of the association relationships, computation resources of USVs, multi-UIRS phase shifts, and multi-UIRS trajectories is formulated. To solve the mixed-integer nonlinear programming problem, we decompose it into two layers and propose an integrated convex optimization and deep reinforcement learning algorithm to attain the near-optimal solution. Specifically, the inner layer solves the discrete variables by using the convex optimization based on Dinkelbach and relaxation methods, and the outer layer optimizes the continuous variables based on the Multi-Agent Twin Delayed Deep Deterministic Policy Gradient (MATD3). The numerical results demonstrate that the proposed algorithm can effectively improve the energy efficiency of the multi-UIRS-assisted marine vehicle system in comparison with the benchmarks. Full article
(This article belongs to the Special Issue Unmanned Marine Vehicles: Navigation, Control and Sensing)
Show Figures

Figure 1

Figure 1
<p>The multi-UIRS-assisted marine vehicle system model.</p>
Full article ">Figure 2
<p>Framework for the MATD3-based EEM-Outer algorithm.</p>
Full article ">Figure 3
<p>The multi-UIRS trajectories achieved by CO-MATD3. (<b>a</b>) The view of the 3D trajectory; (<b>b</b>) the view of the 2D trajectory.</p>
Full article ">Figure 4
<p>Accumulated reward convergence comparison for different learning rates.</p>
Full article ">Figure 5
<p>Convergence performance comparison between CO-MATD3 and CO-SATD3.</p>
Full article ">Figure 6
<p>Energy efficiency versus different numbers of UIRSs.</p>
Full article ">Figure 7
<p>Energy efficiency versus different numbers of USVs.</p>
Full article ">Figure 8
<p>The energy efficiency and total computation data versus the maximum computation resources of the USV. (<b>a</b>) Energy efficiency; (<b>b</b>) total computation data.</p>
Full article ">Figure 9
<p>The energy efficiency and total computation data versus the transmission power of the USV. (<b>a</b>) Energy efficiency; (<b>b</b>) total computation data.</p>
Full article ">Figure 10
<p>Energy efficiency comparison with different UIRS mobility schemes.</p>
Full article ">
17 pages, 1577 KiB  
Article
Intelligent Traffic Control Decision-Making Based on Type-2 Fuzzy and Reinforcement Learning
by Yunrui Bi, Qinglin Ding, Yijun Du, Di Liu and Shuaihang Ren
Electronics 2024, 13(19), 3894; https://doi.org/10.3390/electronics13193894 - 1 Oct 2024
Viewed by 561
Abstract
Intelligent traffic control decision-making has long been a crucial issue for improving the efficiency and safety of the intelligent transportation system. The deficiencies of the Type-1 fuzzy traffic control system in dealing with uncertainty have led to a reduced ability to address traffic [...] Read more.
Intelligent traffic control decision-making has long been a crucial issue for improving the efficiency and safety of the intelligent transportation system. The deficiencies of the Type-1 fuzzy traffic control system in dealing with uncertainty have led to a reduced ability to address traffic congestion. Therefore, this paper proposes a Type-2 fuzzy controller for a single intersection. Based on real-time traffic flow information, the green timing of each phase is dynamically determined to achieve the minimum average vehicle delay. Additionally, in traffic light control, various factors (such as vehicle delay and queue length) need to be balanced to define the appropriate reward. Improper reward design may fail to guide the Deep Q-Network algorithm to learn the optimal strategy. To address these issues, this paper proposes a deep reinforcement learning traffic control strategy combined with Type-2 fuzzy control. The output action of the Type-2 fuzzy control system replaces the action of selecting the maximum output Q-value of the target network in the DQN algorithm, reducing the error caused by the use of the max operation of the target network. This approach improves the online learning rate of the agent and increases the reward value of the signal control action. The simulation results using the Simulation of Urban MObility platform show that the traffic signal optimization control proposed in this paper has achieved significant improvement in traffic flow optimization and congestion alleviation, which can effectively improve the traffic efficiency in front of the signal light and improve the overall operation level of traffic flow. Full article
(This article belongs to the Special Issue Smart Vehicles and Smart Transportation Research Trends)
Show Figures

Figure 1

Figure 1
<p>Single intersection signal light control model.</p>
Full article ">Figure 2
<p>There are three multiple panels in the process of converting the traffic state into the input matrix.</p>
Full article ">Figure 3
<p>Four-phase signal diagram.</p>
Full article ">Figure 4
<p>Traffic decision principle diagram based on Type2-FDQN algorithm.</p>
Full article ">Figure 5
<p>The workflow of the traffic decision-making process based on the Type-2-FDQN algorithm.</p>
Full article ">Figure 6
<p>SUMO simulation single-intersection simulation environment.</p>
Full article ">Figure 7
<p>Software simulation process.</p>
Full article ">Figure 8
<p>Trend chart of average cumulative reward value.</p>
Full article ">Figure 9
<p>Average queue length of the vehicle.</p>
Full article ">Figure 10
<p>Average speed of vehicle.</p>
Full article ">Figure 11
<p>Average waiting time of the vehicle.</p>
Full article ">Figure 12
<p>Total waiting time of vehicle.</p>
Full article ">Figure 13
<p>Average vehicle speed under different traffic volumes.</p>
Full article ">Figure 14
<p>Average vehicle queue length under different traffic volumes.</p>
Full article ">
22 pages, 1246 KiB  
Article
SROR: A Secure and Reliable Opportunistic Routing for VANETs
by Huibin Xu and Ying Wang
Vehicles 2024, 6(4), 1730-1751; https://doi.org/10.3390/vehicles6040084 - 30 Sep 2024
Viewed by 415
Abstract
In Vehicular Ad Hoc Networks (VANETs), high mobility of vehicles issues a huge challenge to the reliability and security of transmitting packets. Therefore, a Secure and Reliable Opportunistic Routing (SROR) is proposed in this paper. During construction of Candidate Forwarding Nodes (CFNs) set, [...] Read more.
In Vehicular Ad Hoc Networks (VANETs), high mobility of vehicles issues a huge challenge to the reliability and security of transmitting packets. Therefore, a Secure and Reliable Opportunistic Routing (SROR) is proposed in this paper. During construction of Candidate Forwarding Nodes (CFNs) set, the relative velocity, connectivity probability, and packet forwarding ratio are taken into consideration. The aim of SROR is to maximally improve the packet delivery ratio as well as reduce the end-to-end delay. The selection of a relay node from CFNs is formalized as a Markov Decision Process (MDP) optimization. The SROR algorithm extracts useful knowledge from historical behavior of nodes by interacting with the environment. This useful knowledge are utilized to select the relay node as well as to prevent the malicious nodes from forwarding packets. In addition, the influence of different learning rate and exploratory factor policy on rewards of agents are analyzed. The experimental results show that the performance of SROR outperforms the benchmarks in terms of the packet delivery ratio, end-to-end delay, and attack success ratio. As vehicle density ranges from 10 to 50 and percentage of malicious vehicles is fixed at 10%, the average of packet delivery ratio, end-to-end delay, and attack success ratio are 0.82, 0.26s, and 0.37, respectively, outperforming benchmark protocols. Full article
Show Figures

Figure 1

Figure 1
<p>A typical network structure of VANETs.</p>
Full article ">Figure 2
<p>System model.</p>
Full article ">Figure 3
<p>The idea of opportunistic routing.</p>
Full article ">Figure 4
<p>An <span class="html-italic">m</span> hops path from a source node to its destination.</p>
Full article ">Figure 5
<p>Structure of SROR.</p>
Full article ">Figure 6
<p>Learning rate for OneCycleLR policy: (<b>a</b>) from episode 1 to 20,000; (<b>b</b>) from episode 12,000 to 20,000.</p>
Full article ">Figure 7
<p>Average reward and cumulative rewards for the OneCycleLR policy. (<b>a</b>) Average reward. (<b>b</b>) Cumulative rewards.</p>
Full article ">Figure 8
<p>Effect of <math display="inline"><semantics> <mi>ε</mi> </semantics></math> on reward. (<b>a</b>) Average reward. (<b>b</b>) Cumulative rewards.</p>
Full article ">Figure 9
<p>Comparison of the performance under different vehicle densities. (<b>a</b>) Packet delivery ratio. (<b>b</b>) End-to-end delay. (<b>c</b>) Attack success ratio.</p>
Full article ">Figure 10
<p>Comparison of the performance under different <math display="inline"><semantics> <mi>σ</mi> </semantics></math>. (<b>a</b>) Packet delivery ratio. (<b>b</b>) End-to-end delay. (<b>c</b>) Attack success ratio.</p>
Full article ">
37 pages, 8342 KiB  
Article
Evaluation of the Impacts of On-Demand Bus Services Using Traffic Simulation
by Sohani Liyanage, Hussein Dia, Gordon Duncan and Rusul Abduljabbar
Sustainability 2024, 16(19), 8477; https://doi.org/10.3390/su16198477 - 29 Sep 2024
Viewed by 574
Abstract
This paper uses smart card data from Melbourne’s public transport network to model and evaluate the impacts of a flexible on-demand transport system. On-demand transport is an emerging mode of urban passenger transport that relies on meeting passenger demand for travel using dynamic [...] Read more.
This paper uses smart card data from Melbourne’s public transport network to model and evaluate the impacts of a flexible on-demand transport system. On-demand transport is an emerging mode of urban passenger transport that relies on meeting passenger demand for travel using dynamic and flexible scheduling using shared vehicles. Initially, a simulation model was developed to replicate existing fixed-schedule bus performance and was then extended to incorporate on-demand transport services within the same network. The simulation results were used to undertake a comparative analysis which included reliability, service quality, operational efficiency, network-wide effectiveness, and environmental impacts. The results showed that on-demand buses reduced average passenger trip time by 30%, increased vehicle occupancy rates from 8% to over 50%, and reduced emissions per passenger by over 70% on an average weekday compared to fixed-schedule buses. This study also offers insights for successful on-demand transport implementation, promoting urban sustainability. It also outlines future research directions, particularly the need for accurate short-term passenger demand prediction to improve service provision and passenger experience. Full article
Show Figures

Figure 1

Figure 1
<p>(<b>a</b>) Selected study area in southeast Melbourne (<b>b</b>) Bus stop locations within the study cordon area. Source: Authors. Produced using Java version 8 in the Eclipse integrated development platform.</p>
Full article ">Figure 2
<p>Trip inclusions and exclusions for bus route 220.</p>
Full article ">Figure 3
<p>(<b>a</b>) Weekday, (<b>b</b>) Saturday, and (<b>c</b>) Sunday bus passenger trip distribution (person trips per day).</p>
Full article ">Figure 4
<p>Bus and passenger agents in the simulation model within the network from start to end.</p>
Full article ">Figure 5
<p>Modeled versus observed passenger travel times for average weekdays.</p>
Full article ">Figure 6
<p>Completed average passenger trip time.</p>
Full article ">Figure 7
<p>Hourly vehicle utilization rate.</p>
Full article ">Figure 8
<p>Completed passenger trip time.</p>
Full article ">Figure 9
<p>Completed transit trip time.</p>
Full article ">Figure 10
<p>Passenger wait time at stops.</p>
Full article ">
15 pages, 2600 KiB  
Article
Contribution of the Mobilome to the Configuration of the Resistome of Corynebacterium striatum
by Catherine Urrutia, Benjamin Leyton-Carcaman and Michel Abanto Marin
Int. J. Mol. Sci. 2024, 25(19), 10499; https://doi.org/10.3390/ijms251910499 - 29 Sep 2024
Viewed by 350
Abstract
Corynebacterium striatum, present in the microbiota of human skin and nasal mucosa, has recently emerged as a causative agent of hospital-acquired infections, notable for its resistance to multiple antimicrobials. Its mobilome comprises several mobile genetic elements, such as plasmids, transposons, insertion sequences [...] Read more.
Corynebacterium striatum, present in the microbiota of human skin and nasal mucosa, has recently emerged as a causative agent of hospital-acquired infections, notable for its resistance to multiple antimicrobials. Its mobilome comprises several mobile genetic elements, such as plasmids, transposons, insertion sequences and integrons, which contribute to the acquisition of antimicrobial resistance genes. This study analyzes the contribution of the C. striatum mobilome in the transfer and dissemination of resistance genes. In addition, integrative and conjugative elements (ICEs), essential in the dissemination of resistance genes between bacterial populations, whose role in C. striatum has not yet been studied, are examined. This study examined 365 C. striatum genomes obtained from the NCBI Pathogen Detection database. Phylogenetic and pangenome analyses were performed, the resistance profile of the bacterium was recognized, and mobile elements, including putative ICE, were detected. Bioinformatic analyses identified 20 antimicrobial resistance genes in this species, with the Ermx gene being the most predominant. Resistance genes were mainly associated with plasmid sequence regions and class 1 integrons. Although an ICE was detected, no resistance genes linked to this element were found. This study provided valuable information on the geographic spread and prevalence of outbreaks observed through phylogenetic and pangenome analyses, along with identifying antimicrobial resistance genes and mobile genetic elements that carry many of the resistance genes and may be the subject of future research and therapeutic approaches. Full article
(This article belongs to the Special Issue Evolution and Genomics: Relevance to Current Issues)
Show Figures

Figure 1

Figure 1
<p>Genomic landscape of antibiotic resistance in <span class="html-italic">C. striatum</span>. The heatmap represents a binary matrix of presence (purple) and absence (white) of 20 antimicrobial resistance genes in 365 <span class="html-italic">C. striatum</span> genomes. Binary distance was used to calculate the similarity between resistance profiles, and the complete hierarchical clustering algorithm (complete linkage) was used to group genomes and genes. The dendrogram on the left shows the clustering of strains based on the similarity of their resistance profiles, while the upper dendrogram indicates the similarity in gene co-occurrence. The red boxes indicate possible MGEs, while the different lineages (please see the <a href="#ijms-25-10499-f002" class="html-fig">Figure 2</a>) are represented in the dendrogram on the left.</p>
Full article ">Figure 2
<p>Population diversity and resistance in <span class="html-italic">C. striatum</span>. Bacterial populations were determined using RhierBAPS and are represented by colored circles in each tree tip. The most abundant antibiotic resistance genes are shown in purple and have been grouped into two categories according to their relationship or hypothetical origin: (1) circles for AMR genes related to pJA144188 and (2) squares for those related to pTP10. The tree was constructed using a GTR model with 1000 bootstrap replicates. Rooting (midpoint) and visualization were performed using the online tool iTol (<a href="https://itol.embl.de" target="_blank">https://itol.embl.de</a>).</p>
Full article ">Figure 3
<p>Comparison of plasmid sequences with <span class="html-italic">C. striatum</span> lineages. (<b>A</b>) Plasmid pTP10 is distinguished by modules in dark purple, which represent AMR genes. The regions where transposons are located in the plasmid are represented with red letters above the modules. The genomes belonging to each lineage CS-2, CS-8, and CS-3 are aligned in blue horizontal lines, which demonstrate the regions and genes they share. (<b>B</b>) The plasmid pJA144188, comprising five modules, has been aligned with the lineages CS-10 and CS-4. Module V contains a class 1 integron that is shared with the lineages, in addition to the resistance gene <span class="html-italic">tet(W)</span> in module III.</p>
Full article ">Figure 4
<p>Similarities of plasmids pTP10 from <span class="html-italic">C. striatum</span> and pJA144188 from <span class="html-italic">C. resistens</span>. The purple arrows indicate the coding sequence (CDS) of the pTP10 plasmid, while the numbers above them represent the plasmid modules. Transposons are shown with red letters. The pTP10 plasmid is aligned with the pJA144188 plasmid, as indicated by the blue lines, which represent regions that share similarities between these plasmids.</p>
Full article ">
28 pages, 6900 KiB  
Article
A DPSIR-Driven Agent-Based Model for Residential Choices and Mobility in an Urban Setting
by Flann Chambers, Giovanna Di Marzo Serugendo and Christophe Cruz
Sustainability 2024, 16(18), 8181; https://doi.org/10.3390/su16188181 - 19 Sep 2024
Viewed by 606
Abstract
Sustainability in cities, and its accurate and exhaustive assessment, represent a major keystone of environmental sciences and policy making in urban planning. This study aims to provide methods for a reproducible, descriptive, predictive and prescriptive analysis of urban residential choices and mobility, which [...] Read more.
Sustainability in cities, and its accurate and exhaustive assessment, represent a major keystone of environmental sciences and policy making in urban planning. This study aims to provide methods for a reproducible, descriptive, predictive and prescriptive analysis of urban residential choices and mobility, which are key components of an urban system’s sustainability. Using the DPSIR framework for building agent evolution rules, we design an agent-based model of the canton of Geneva, Switzerland. The model leverages real geographical data for the canton of Geneva and its public transportation network. The resulting simulations show the dynamics of the relocation choices of commuters, in terms of the function of their travel time by public transportation to their workplace. Results show that areas around the city centre are generally preferred, but high rent prices and housing availability may prevent most residents from relocating to these areas. Other preferred housing locations are distributed around major tram and train lines and where rent prices are generally lower. The model and its associated tools are capable of spatialising aggregated statistical datasets, inferring spatial correlations, and providing qualitative and quantitative analysis of relocation dynamics. Such achievements are made possible thanks to the efficient visualisation of our results. The agent-based modelling methodology represents an adequate solution for understanding complex phenomena related to sustainability in urban systems, which can be used as guidance for policy making. Full article
(This article belongs to the Special Issue Smart and Sustainable Cities and Regions)
Show Figures

Figure 1

Figure 1
<p>The DPSIR framework, developed by Smeets et al., 1999 [<a href="#B11-sustainability-16-08181" class="html-bibr">11</a>]. The dotted-line arrow between Responses and Impacts is sometimes absent from the various DPSIR framework implementations.</p>
Full article ">Figure 2
<p>DPSIR graph for the canton of Geneva case study.</p>
Full article ">Figure 3
<p>Methodology workflow for gathering input data, building model evolution rules, producing simulation output data, then visualising and analysing it, and finally validating the model. When relevant, elements of the workflow are indexed with their dedicated section in this paper, denoted as (<b>s4.1</b>) for <a href="#sec4dot1-sustainability-16-08181" class="html-sec">Section 4.1</a>, for instance.</p>
Full article ">Figure 4
<p>Validation results for simulation 6: plots of the relocation rate in function of time. The red curve represents the simulated data, the green curve represents the real-world data from OCSTAT (relocation rate equal to 9.6% of the total population per year). The plot is directly sourced from and automatically generated by the web application.</p>
Full article ">Figure 5
<p>Map of the average rent prices across the canton of Geneva, obtained directly from the web application for month 1 of simulation 6. Each circle corresponds to one address; the size of the circle represents the number of commuters living at that address, and the colour of the circle represents the average rent price, expressed in CHF/m<sup>2</sup>. The basemap originates from OpenStreetMap via the Leaflet plugin used by the Dash library.</p>
Full article ">Figure 6
<p>Map of the relocation dynamics per address across the canton of Geneva, obtained directly from the web application for month 36 of simulation 4. Each circle corresponds to one address; the size of the circle represents the amount of commuters having moved into the address, and the colour of the circle represents the amount of commuters having moved out of the address. The basemap originates from OpenStreetMap via the Leaflet plugin used by the Dash library.</p>
Full article ">Figure 7
<p>Map of the happiness/satisfaction status for each commuter in the canton of Geneva, obtained directly from the web application for months 5 (<b>left</b>) and 36 (<b>right</b>) of simulation 4. Each circle corresponds to one commuter; the colour of the circle represents the happiness status of the commuter: blue if happy, red if not. The basemap originates from OpenStreetMap via the Leaflet plugin used by the Dash library.</p>
Full article ">Figure 8
<p>Plots of the average travel time (<b>left</b>) and happiness/satisfaction status (<b>right</b>) of commuters in the canton of Geneva, in terms of the function of time (expressed in months), obtained directly from the web application for Simulation 4. The curves validate the overall trend observed in the maps.</p>
Full article ">Figure 9
<p>Relocation rate plots for simulations 1 (<b>left</b>) and 2 (<b>right</b>) in function of time. The red curve represents the simulated data, the green curve represents the real-world data from OCSTAT (relocation rate equal to 9.6% of the total population per year). The plot is directly sourced from and automatically generated by the web application.</p>
Full article ">Figure 10
<p>Relocation rate plots for simulations 3 (<b>left</b>) and 4 (<b>right</b>) in function of time. The red curve represents the simulated data, the green curve represents the real-world data from OCSTAT (relocation rate equal to 9.6% of the total population per year). The plot is directly sourced from and automatically generated by the web application.</p>
Full article ">Figure 11
<p>Relocation rate plots for simulations 5 (<b>left</b>) and 6 (<b>right</b>) in function of time. The red curve represents the simulated data, the green curve represents the real-world data from OCSTAT (relocation rate equal to 9.6% of the total population per year). The plot is directly sourced from and automatically generated by the web application.</p>
Full article ">Figure 12
<p>Map of the amount of commuters having moved into addresses around the canton of Geneva by month 36 of simulation 6. Only addresses which have been created by the government during the simulation, in response to the population growth, are pictured. The map is obtained directly from the web application for month 36 of simulation 4. Each circle corresponds to one address; the colour of the circle represents the amount of commuters having moved into the address. The basemap originates from OpenStreetMap via the Leaflet plugin used by the Dash library.</p>
Full article ">
19 pages, 11959 KiB  
Article
Learning Autonomous Navigation in Unmapped and Unknown Environments
by Naifeng He, Zhong Yang, Chunguang Bu, Xiaoliang Fan, Jiying Wu, Yaoyu Sui and Wenqiang Que
Sensors 2024, 24(18), 5925; https://doi.org/10.3390/s24185925 - 12 Sep 2024
Viewed by 445
Abstract
Autonomous decision-making is a hallmark of intelligent mobile robots and an essential element of autonomous navigation. The challenge is to enable mobile robots to complete autonomous navigation tasks in environments with mapless or low-precision maps, relying solely on low-precision sensors. To address this, [...] Read more.
Autonomous decision-making is a hallmark of intelligent mobile robots and an essential element of autonomous navigation. The challenge is to enable mobile robots to complete autonomous navigation tasks in environments with mapless or low-precision maps, relying solely on low-precision sensors. To address this, we have proposed an innovative autonomous navigation algorithm called PEEMEF-DARC. This algorithm consists of three parts: Double Actors Regularized Critics (DARC), a priority-based excellence experience data collection mechanism, and a multi-source experience fusion strategy mechanism. The algorithm is capable of performing autonomous navigation tasks in unmapped and unknown environments without maps or prior knowledge. This algorithm enables autonomous navigation in unmapped and unknown environments without the need for maps or prior knowledge. Our enhanced algorithm improves the agent’s exploration capabilities and utilizes regularization to mitigate the overestimation of state-action values. Additionally, the priority-based excellence experience data collection module and the multi-source experience fusion strategy module significantly reduce training time. Experimental results demonstrate that the proposed method excels in navigating the unmapped and unknown, achieving effective navigation without relying on maps or precise localization. Full article
Show Figures

Figure 1

Figure 1
<p>Robot navigates through an Unknown Environment.</p>
Full article ">Figure 2
<p>Proposed algorithmic structural framework for autonomous navigation and autonomous obstacle avoidance.</p>
Full article ">Figure 3
<p>Double agents can assist in overcoming local optima.</p>
Full article ">Figure 4
<p>Priority excellent experience data collection strategy.</p>
Full article ">Figure 5
<p>Ablation study of multi-source experience fusion strategy.</p>
Full article ">Figure 6
<p>The DRL algorithm comprises actors and critics, with each layer specifying its corresponding number of parameters.</p>
Full article ">Figure 7
<p>Unmapped and unknown environment employed for the training of the robot.</p>
Full article ">Figure 8
<p>Ablation study of an enhanced DRL algorithm in unmapped and unknown environments.</p>
Full article ">Figure 9
<p>Q value and reward value in the first environment.</p>
Full article ">Figure 10
<p>Q value and reward value in the second environment.</p>
Full article ">Figure 11
<p>The unmapped environment used for robot testing.</p>
Full article ">Figure 12
<p>Success rate of 1000 tests in unmapped and unknown environments.</p>
Full article ">Figure 13
<p>Unknown and complex experimental environments in real world.</p>
Full article ">Figure 14
<p>Comparison of trajectories in the first environment.</p>
Full article ">Figure 15
<p>Comparison of trajectories in the second environment.</p>
Full article ">Figure 16
<p>Success rate of 10 tests in two environments.</p>
Full article ">
20 pages, 6757 KiB  
Article
A Task Offloading and Resource Allocation Strategy Based on Multi-Agent Reinforcement Learning in Mobile Edge Computing
by Guiwen Jiang, Rongxi Huang, Zhiming Bao and Gaocai Wang
Future Internet 2024, 16(9), 333; https://doi.org/10.3390/fi16090333 - 11 Sep 2024
Viewed by 676
Abstract
Task offloading and resource allocation is a research hotspot in cloud-edge collaborative computing. Many existing pieces of research adopted single-agent reinforcement learning to solve this problem, which has some defects such as low robustness, large decision space, and ignoring delayed rewards. In view [...] Read more.
Task offloading and resource allocation is a research hotspot in cloud-edge collaborative computing. Many existing pieces of research adopted single-agent reinforcement learning to solve this problem, which has some defects such as low robustness, large decision space, and ignoring delayed rewards. In view of the above deficiencies, this paper constructs a cloud-edge collaborative computing model, and related task queue, delay, and energy consumption model, and gives joint optimization problem modeling for task offloading and resource allocation with multiple constraints. Then, in order to solve the joint optimization problem, this paper designs a decentralized offloading and scheduling scheme based on “task-oriented” multi-agent reinforcement learning. In this scheme, we present information synchronization protocols and offloading scheduling rules and use edge servers as agents to construct a multi-agent system based on the Actor–Critic framework. In order to solve delayed rewards, this paper models the offloading and scheduling problem as a “task-oriented” Markov decision process. This process abandons the commonly used equidistant time slot model but uses dynamic and parallel slots in the step of task processing time. Finally, an offloading decision algorithm TOMAC-PPO is proposed. The algorithm applies the proximal policy optimization to the multi-agent system and combines the Transformer neural network model to realize the memory and prediction of network state information. Experimental results show that this algorithm has better convergence speed and can effectively reduce the service cost, energy consumption, and task drop rate under high load and high failure rates. For example, the proposed TOMAC-PPO can reduce the average cost by from 19.4% to 66.6% compared to other offloading schemes under the same network load. In addition, the drop rate of some baseline algorithms with 50 users can achieve 62.5% for critical tasks, while the proposed TOMAC-PPO only has 5.5%. Full article
(This article belongs to the Special Issue Convergence of Edge Computing and Next Generation Networking)
Show Figures

Figure 1

Figure 1
<p>Cloud-edge collaboration model for MEC network.</p>
Full article ">Figure 2
<p>Task computing and transmission queues.</p>
Full article ">Figure 3
<p>Synchronization timeout due to disconnection (The blue arrow is the direction of information transmission, and the red cross indicates that the sender and receiver are not connected).</p>
Full article ">Figure 4
<p>Offloading and scheduling when user moves across cell (The numbers ①–⑥ represent the order in which the scheduling rules are executed).</p>
Full article ">Figure 5
<p>Multi-agent system based on the Actor–Critic framework.</p>
Full article ">Figure 6
<p>Task-oriented Markov decision process.</p>
Full article ">Figure 7
<p>Policy network structure.</p>
Full article ">Figure 8
<p>Value network structure.</p>
Full article ">Figure 9
<p>Clipped summarize objective schematic diagram.</p>
Full article ">Figure 10
<p>Offloading and allocation algorithms conversion and cumulative rewards versus episodes.</p>
Full article ">Figure 11
<p>Average task cost versus user number.</p>
Full article ">Figure 12
<p>Average task cost versus failure probability.</p>
Full article ">Figure 13
<p>Optimization effect of schemes on the key performance metrics of different types of tasks.</p>
Full article ">
Back to TopTop