Edge AIoT & Microelectronics (EdgeAIoTM) Engineering Skills for Gifted Students
P4L1.1 Introduction to AI Internet of Things (AIoT) and Edge Computing
Today’s Lesson
❖ Introduction to computer networking and the Internet
❖ Basics of Internet of Things (IoT)
❖ Basics of AI Internet of Things (AIoT)
❖ Edge Computing Fundamentals
❖ Edge IoT system Design and development
❖ Lab session:
○ Smart Temperature Monitoring Automation using ThingsBoard
2
Intended Learning Outcomes
At the end of this lesson, students are expected to:
1. Understand the fundamental concepts of computer networking
and the Internet, including protocols and addressing
2. Explain the basic structure, components, and applications of the
Internet of Things (IoT)
3. Describe the integration of artificial intelligence with IoT to form
AIoT systems for smart decision-making
4. Analyse the role of edge computing in enabling low-latency and
efficient real-time IoT applications
5. Design and evaluate a simple edge-based IoT system,
considering scalability, reliability, and efficiency
3
Program Structure
Start of
Phase 4
4
Further Reading/Recommended Books
[1] Getting started with Internet of Things, by Cuno Pfister
[2] Smart Wireless Sensing, connected via Internet. by Zheng Yang
[3] Edge Computing: Systems and Applications,. by Lanyu Xu
2
1 3
5
What is a Computer Network?
❖ System of two or more interconnected computing
devices
❖ Computers, printers, mobile phones, etc.
❖ Communicate and exchange information/resources
❖ Connections:
✔ Wired: Coaxial cables, phone lines, twisted-pair
cabling, and optical fibers.
✔ Wireless: radio waves, cellular, satellites, etc.
6
Components of Computer Network?
7
Network Types by Geographical Area
LAN • Local area network (LAN) – short
MAN distance e.g., buildings, organizations
WAN
• Wide area network (WAN) - Large
CAN Networks WLAN areas, such as regions and continents.
• Metropolitan area network (MAN):
VPN EPN Smaller than WAN e.g. Cities
PAN
• Personal area network (PAN): Serves
one person
https://www.newyorkcables.com/updates/most-important-types-of-computer-networks-in-todays-age/
8
Networking Devices and Components
• IP address: the unique number assigned to every network device.
• Nodes: Connection points that can receive, send, create, or store data.
• Router: Physical or virtual device that distributes “packets” between networks
• Switches: Connects network devices and manages node-to-node communication
across a network
• Ports: Determines which application, service, or process should receive which
messages
• Gateways: Devices that facilitate communication between two different networks,
e.g., routers, firewall, or servers.
https://www.ibm.com/topics/networking 9
Networking Devices
https://www.ibm.com/topics/networking 10
Communication Protocols
Networked devices rely on communication protocols; rules that describe how to
transmit or exchange data across a network.
11
Transmission control Protocol (TCP)
• is a connection-oriented and reliable end-to-end protocol
• Uses the 3-way handshake process
• Guarantee the ordering and sequencing of messages
• Packet is re-transmitted when not received.
• Used by HTTP, HTTPs, FTP, SMTP, Telnet, etc
12
(UDP)
• Is connectionless and not reliable
• Just transmits data without notice to the destination
• Suitable for time-sensitive situations, such as Domain Name System (DNS)
lookup, Voice over Internet Protocol (VoIP), and streaming media.
https://www.geeksforgeeks.org/user-datagram-protocol-udp/ 13
HyperText Transfer Protocol (HTTP)
• Protocol used to fetch web content using a browser
• Works on top of TCP
14
Message Queuing Telemetry Transport (MQTT)
• Is an OASIS standard messaging protocol for the Internet of Things (IoT).
• It is designed as an extremely lightweight publish/subscribe protocol.
• MQTT today is used in a wide variety of industries, such as automotive,
manufacturing, telecommunications, oil and gas, etc
15
Internet: Meaning and History
• Word Internet is a short form of internetworking
• It is a network of networks, globally
• A network consists of interconnected computers
• Started in the US ARPANET published in 1967
• ARPA connected four US campuses in 1969
• TCP was invented by Vinton Cerf and Robert Kahn
in the1970s end)
• It allows the mini networks to communicate
16
Internet: Meaning and History
17
What is Internet of Things (IoT)?
• IoT is the network of physical objects — devices, vehicles, buildings, and other
items embedded with electronics, software, sensors, and network connectivity
Objects can include:
• Smart buildings and home
appliances
Fridges, TVs, cookers
• Civil engineering structures
Bridges, railways
• Wearable devices
Smart watches, glasses
• Medical devices
Smart inhaler, embedded pills
18
Goal of Internet of Things (IoT)?
❖ Connect things anytime, anyplace,
with anything and anyone ideally
using any path/network and any
service
19
Characteristics of IoT
• Intelligence
• Connectivity
• Dynamic Nature
• Enormous scale
• Sensing
• Heterogeneity
• Security
20
IoT Applications
21
Use cases: Efficient Smart Cities Waste
Management
22
IoT Applications in Traffic => Smart Mobility
23
IoT Applications in Health => Smart Living
24
IoT Applications in Agriculture => Smart
Environment
25
IoT Applications in Education => Smart People
26
IoT System Architecture
27
IoT System Architecture
28
IoT System Architecture: End Devices
29
List of IoT Sensors
• Temperature Sensor
• Proximity Sensor
• Pressure Sensor
• Water Quality Sensor
• Chemical/Smoke & Gas Sensor
• Level Sensor
• IR Sensor
• Ultrasonic Sensor
• Image sensors
• Motion Detection Sensors
• Accelerometer Sensors
• Gyrometer Sensors
• Humidity Sensors https://mspoweruser.com/microsofts-new-iot-grove-kit-
• Optical Sensors makes-it-easier-to-explore-the-internet-of-things/
30
IoT System Architecture: Gateways & Connectivity
31
Challenges in IoT
• Power constraints
• Cost (Devices + data transmission)
• Communication protocols / Data transmission distance
• Security
Confidentiality
Authentication
Integrity
32
Different Wireless Protocol
33
IoT Communication Protocols
Example:
Size of our CNN notebook:
~14KB
We can send ~3 notebooks
per second if using LoRa
https://www.postscapes.com/internet-of-things-protocols/#protocols
34
IoT Communication Protocols
LoRaWAN® Network Architecture
https://lora-alliance.org/about-lorawan/
35
IoT platforms
ThingsBoard
Thingsquare
Riot OS
Mist
36
What is AIoT?
• AIoT = AI + IoT
• Provides intelligence to IoT
• Data can be processed near the data source to reduce transmission cost
(Edge computing)
AI AIoT IoT
37
Case Study
• Personal Protective Equipment Detection:
YOLO
(Object Detection)
Camera AI Output
https://github.com/Sankarlalr23/Detection-of-PPE-Compliance-on-Construction-Site-Using-CV
38
Case Study
• Block diagram:
39
Home Assistant
• A connected device to provide assistant to your daily life
40
Control your home
• Some can control your home appliance remotely, centralized and
automated
41
Control your home
• Some can control your home appliance remotely, centralized and
automated
42
Echo Working as Chatbot
43
Echo Working as Automation Asistant
44
Edge Computing
https://semiconductor.samsung.com/support/tools-resources/dictionary/edge-computing/
45
Cloud Computing vs Edge Computing
Cloud Computing Edge Computing
Location of data Further away from data source, Near data source,
processing i.e., on the cloud i.e. on edge devices, or server
nearby
Features Higher data transit cost, higher Lower data transmission cost,
latency, centralized, data sharing lower latency (real-time analytics
with cloud provider and
decision making), decentralized,
protect data privacy/sovereignty
Connectivity Must be reliable, Lower requirements of network
high network connection reliability
throughput
46
Cloud Computing vs Edge Computing
Cloud Computing Edge Computing
Availability of Abundance Need to be used efficiently
resources
(i.e. Power,
computing
resources, etc)
Hardware Nvidia: K80, P100, P4, T4, Nvidia: Jetson family
V100, A100, etc (nano, TX2, Xavier NX, etc)
Xilinx: Alveo U50, U200, U250, Xilinx: Ultra96, ZCU102,
etc ZCU104, Kria K26, VCK190, etc
47
Market size of IoT
• The global smart cities market held a market value of USD 114,901.8 Million in
2020 and is forecasted to reach USD 670,424.1 Million by the year 2030
• The market is expected to register a CAGR of 20.5% during the forecast period
• The IoT technology market is expected to grow from USD 384.5 billion in 2021
to USD 566.4 billion by 2027, at a CAGR of 6.7%
48
Future of IoT
49
Future of IoT
50
51
Cloud vs Edge
52
53
54
Lab Exercise
❖ Introduction to IoT and Edge Computing using ThingsBoard and Wokwi simulation with ESP32
ThingsBoard
Wokwi
55
Happy learning, please ask questions !!!
18
