Nowadays,
Internet of Things (IoT) application systems are broadly applied to various sectors of society for efficient management by monitoring environments using sensors, analyzing sampled data, and giving proper feedback. For their fast deployment, we have developed
Smart Environmental Monitoring and Analysis in
[...] Read more.
Nowadays,
Internet of Things (IoT) application systems are broadly applied to various sectors of society for efficient management by monitoring environments using sensors, analyzing sampled data, and giving proper feedback. For their fast deployment, we have developed
Smart Environmental Monitoring and Analysis in Real Time (SEMAR) as an integrated IoT application server platform and implemented the
input setup assistance service using
prompt engineering and a
generative AI model to assist connecting sensors to
SEMAR with step-by-step guidance. However, the current service cannot assist in connections of the sensors not learned by the AI model, such as newly released ones. To address this issue, in this paper, we propose an extension to the service for handling unlearned sensors by utilizing datasheets with four steps: (1) users input a PDF datasheet containing information about the sensor, (2) key specifications are extracted from the datasheet and structured into markdown format using a
generative AI, (3) this data is saved to a
vector database using
chunking and
embedding methods, and (4) the data is used in
Retrieval-Augmented Generation (RAG) to provide additional context when guiding users through sensor setup. Our evaluation with five
generative AI models shows that
OpenAI’s GPT-4o achieves the highest accuracy in extracting specifications from PDF datasheets and the best
answer relevancy (0.987), while
Gemini 2.0 Flash delivers the most balanced results, with the highest overall
RAGAs score (0.76). Other models produced competitive but mixed outcomes, averaging 0.74 across metrics. The
step-by-step guidance function achieved a task success rate above 80%. In a course evaluation by 48 students, the system improved the student test scores, further confirming the effectiveness of our proposed extension.
Full article