Become a leader in the IoT community!

New DevHeads get a 320-point leaderboard boost when joining the DevHeads IoT Integration Community. In addition to learning and advising, active community leaders are rewarded with community recognition and free tech stuff. Start your Legendary Collaboration now!

Step 1 of 5

CREATE YOUR PROFILE *Required

OR
Step 2 of 5

WHAT BRINGS YOU TO DEVHEADS? *Choose 1 or more

Collaboration & Work 🤝
Learn & Grow 📚
Contribute Experience & Expertise 🔧
Step 3 of 5

WHAT'S YOUR INTEREST OR EXPERTISE? *Choose 1 or more

Hardware & Design 💡
Embedded Software 💻
Edge Networking
Step 4 of 5

Personalize your profile

Step 5 of 5

Read & agree to our COMMUNITY RULES

  1. We want this server to be a welcoming space! Treat everyone with respect. Absolutely no harassment, witch hunting, sexism, racism, or hate speech will be tolerated.
  2. If you see something against the rules or something that makes you feel unsafe, let staff know by messaging @admin in the "support-tickets" tab in the Live DevChat menu.
  3. No age-restricted, obscene or NSFW content. This includes text, images, or links featuring nudity, sex, hard violence, or other graphically disturbing content.
  4. No spam. This includes DMing fellow members.
  5. You must be over the age of 18 years old to participate in our community.
  6. Our community uses Answer Overflow to index content on the web. By posting in this channel your messages will be indexed on the worldwide web to help others find answers.
  7. You agree to our Terms of Service (https://www.devheads.io/terms-of-service/) and Privacy Policy (https://www.devheads.io/privacy-policy)
By clicking "Finish", you have read and agreed to the our Terms of Service and Privacy Policy.

Optimizing Sensor Data Transmission: Storing Locally and Sending to IoT Hub

Hi guys I’m working on a Raspberry Pi project where I need to send sensor data to IoT Hub. Due to latency, I lose around 5 samples per second. I’m thinking of storing the data locally in a CSV file every 10 seconds with one process and then reading and sending it to the cloud with another process. How possible is this?
@IoT Cloud

  1. LMtx#0000
  2. Joseph Ogbonna#0000

    Yes, it’s possible to store sensor data locally in a CSV file every 10 seconds with one process and then read and send it to the cloud with another process. This approach can help reduce latency.

    It can also ensure reliable file transmission. But ensure you have proper error handling mechanism in check.

  3. Nehal#0000

    Can you tell us more about what type of data is this? how are you sending data, frequency of sending data? what size and how long is this packet and how are you receiving, parsing and packaging the data?

    Getting more info will definitely be better to comment on your problem.

  4. Daniel kalu#0000

    The data are sensor readings for temperature and humidity. I’m planning to send the data to the IoT Hub using MQTT protocol. The frequency of sending data is around 10 samples per second, but due to latency issues, I lose about 5 samples per second. Each sample is small, about 100 bytes. I receive the data on the Raspberry Pi, parsing it, and then packaging it into CSV format for storage

  5. Nehal#0000

    Instead of collecting and sending data 10 times per second, create an array store the values and send this array as 1 packet per second

    You can also collect more and send that data like array size of 20 for 2 sec interval cycle. Along side you should also store data incase of connection or data lost scenarios.

    Also packet of 100 bytes is kind of big you should try to reduce it if there’s repetitive data residing inside it like MAC address etc it will make your flow lighter to execute

  6. Daniel kalu#0000

    Thanks for the advice! I’ll implement storing data in an array and sending it as one packet per second.

CONTRIBUTE TO THIS THREAD

Browse other Product Reviews tagged

Leaderboard

RANKED BY XP

All time
  • 1.
    Avatar
    @Nayel115
    1620 XP
  • 2.
    Avatar
    @UcGee
    650 XP
  • 3.
    Avatar
    @melta101
    600 XP
  • 4.
    Avatar
    @lifegochi
    250 XP
  • 5.
    Avatar
    @Youuce
    180 XP
  • 6.
    Avatar
    @hemalchevli
    170 XP