![\"GitHub\"](\"https://fiware.github.io/tutorials.Historic-Context-Flume/icon/GitHub-Mark-32px.png\"){kind=icon}
FIWARE 301: Persisting Context DataThis tutorial is an introduction to FIWARE Cygnus - a generic enabler which is used to persist context data into third-party databases creating a historical view of the context. The tutorial activates the IoT sensors connected in the previous tutorial and persists measurements\nfrom those sensors into a database for further analysis.
\nThe docker-compose files for this tutorial can be found on GitHub:
FIWARE 301: Persisting Context Data
\n\n\"History will be kind to me for I intend to write it.\"
\n— Winston Churchill
\n
Previous tutorials have introduced a set of IoT Sensors (providing measurements of the\nstate of the real world), and two FIWARE Components - the Orion Context Broker and an IoT Agent. \nThis tutorial will introduct a new data persistance component - FIWARE Cygnus.
\nThe system so far has been built up to handle the current context, in other words it holds the data entities\ndefining the state of the real-world objects at a given moment in time.
\nFrom this definition you can see - context is only interested in the current state of the system\nIt is not the responsibility of any of the existing components to report on the historical state of the system,\nthe context is based on the last measurement each sensor has sent data to the context broker.
\nIn order to do this, we will need to extend the existing architecture to persist changes of state into a database whenever \nthe context is updated.
\nPersisting historical context data is useful for big data analysis - it can be used to discover trends, or data \ncan be sampled and aggregated to remove the influence of outlying data measurements. However within each Smart Solution,\nthe significance of each entity type will differ and entities and attributes may need to be sampled at different rates.
\nSince the business requirements for using context data differ from application to appliation, there is no one standard use \ncase for historical data persistence - each situation is unique - it is not the case that one size fits all.\nTherefore rather than overloading the context broker with the job of historical context data persistence, this role has been\nseparated out into a separate, highly configurable component - Cygnus.
\nAs you would expect, Cygnus, as part of an Open Source platform, is technology agnostic regarding the database \nto be used for data persistance. The database you choose to use will depend upon your own business needs.
\nHowever there is a cost to offering this flexibility - each part of the system must be separately configured and\nnotifications must be set up to only pass the minimal data required as necessary.
\nFor the purpose of this tutorial, a series of dummy IoT devices have been created, which will be attached to the context broker.\nThe state of each device can be seen on the UltraLight device monitor web-page found at: http://localhost:3000/device/monitor
![\"FIWARE](\"https://fiware.github.io/tutorials.Historic-Context-Flume/img/device-monitor.png\")
This application builds on the components and dummy IoT devices created in \nprevious tutorials. It will make use of three FIWARE components - \nthe Orion Context Broker, the\nIoT Agent for UltraLight 2.0 and introduce the\nCygnus Generic Enabler for persisting context data to a database.\nAdditional databases are now involved - both the Orion Context Broker and the IoT Agent rely on MongoDB technology to keep persistence of the information they hold, and we will be persisting our historical context data another database - either MySQL , PostgreSQL or Mongo-DB database.
\nTherefore the overall architecture will consist of the following elements:
\nSince all interactions between the elements are initiated by HTTP requests, the entities can be containerized and run from exposed ports.
\nThe specific architecture of each section of the tutorial is discussed below.
\nBefore you start you should ensure that you have obtained or built the necessary Docker images locally. Please run
\n./services create\n\n\nNote The
\ncontext-providerimage has not yet been pushed to Docker hub.\nFailing to build the Docker sources before proceeding will result in the following error:Pulling context-provider (fiware/cp-web-app:latest)...\nERROR: The image for the service you're trying to recreate has been removed.\n
Thereafter, all services can be initialised from the command line by running the services Bash script provided within the repository:
\n./services <command>\nWhere <command> will vary depending upon the databases we wish to activate.\nThis command will also import seed data from the previous tutorials and provision the dummy IoT sensors on startup.
\n\n","schema":"https://schema.getpostman.com/json/collection/v2.0.0/collection.json","toc":[{"content":"Data Persistence","slug":"data-persistence"},{"content":"Architecture","slug":"architecture"},{"content":"Start Up","slug":"start-up"}],"owner":"513743","collectionId":"30f69661-209c-43fb-bd7c-d1f1c055731c","publishedId":"RWEcR2DC","public":true,"customColor":{"top-bar":"FFFFFF","right-sidebar":"303030","highlight":"233C68"},"publishDate":"2020-01-02T11:05:59.000Z"},"item":[{"name":"Mongo DB - Persisting Context","item":[{"name":"Cygnus - Obtain version information","id":"5057efd4-669b-41c7-b7b3-23d5eb9729b8","request":{"method":"GET","header":[],"body":{"mode":"formdata","formdata":[]},"url":"http://localhost:5080/v1/version","description":":information_source: Note: If you want to clean up and start over again you can do so with the following command:
\n\n./services stop\n
Once Cygnus is running, You can check the status by making an HTTP request to the exposed CYGNUS_API_PORT port. \nIf the response is blank, this is usually because Cygnus is not running or is listening on another port.
\n\n","urlObject":{"protocol":"http","path":["v1","version"],"host":["localhost:5080"],"query":[],"variable":[]}},"response":[],"_postman_id":"5057efd4-669b-41c7-b7b3-23d5eb9729b8"},{"name":"Orion - Subscribe to Context Changes","id":"13434c50-eae0-4366-8d5d-b44a2d0b7e4e","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"POST","header":[{"key":"Content-Type","value":"application/json"},{"key":"fiware-service","value":"openiot"},{"key":"fiware-servicepath","value":"/"}],"body":{"mode":"raw","raw":"{\n \"description\": \"Notify Cygnus of all context changes\",\n \"subject\": {\n \"entities\": [\n {\n \"idPattern\": \".*\"\n }\n ]\n },\n \"notification\": {\n \"http\": {\n \"url\": \"http://cygnus:5051/notify\"\n }\n },\n \"throttling\": 5\n}"},"url":"http://localhost:1026/v2/subscriptions/","description":"Troubleshooting: What if the response is blank ?
\n\n
\n- To check that a docker container is running try
\n\ndocker ps\nYou should see several containers running. If
\ncygnusis not running, you can restart the containers as necessary.
Once a dynamic context system is up and running, we need to inform Cygnus of changes in context.
\nThis is done by making a POST request to the /v2/subscription endpoint of the Orion Context Broker.
fiware-service and fiware-servicepath headers are used to filter the subscription to only listen to measurements from the attached IoT SensorsidPattern in the request body ensures that Cygnus will be informed of all context data changes.url must match the configured CYGNUS_MONGO_SERVICE_PORTattrsFormat=legacy is required since Cygnus currently only accepts notifications in the older NGSI v1 format.throttling value defines the rate that changes are sampled.As you can see, the database used to persist context data has no impact on the details of the subscription. It is the same for each database.
\n","urlObject":{"protocol":"http","path":["v2","subscriptions",""],"host":["localhost:1026"],"query":[],"variable":[]}},"response":[],"_postman_id":"13434c50-eae0-4366-8d5d-b44a2d0b7e4e"},{"name":"Orion - Check Subscription is working","id":"eb4be0c3-5563-444a-9539-c90ef2df0fda","request":{"method":"GET","header":[{"key":"fiware-service","value":"openiot"},{"key":"fiware-servicepath","value":"/"}],"body":{"mode":"raw","raw":""},"url":"http://localhost:1026/v2/subscriptions/","description":"If a subscription has been created, you can check to see if it is firing by making a GET \nrequest to the /v2/subscriptions endpoint.
Within the notification section of the response, you can see several additional attributes which describe the health of the subscription
If the criteria of the subscription have been met, timesSent should be greater than 0.\nA zero value would indicate that the subject of the subscription is incorrect or the subscription \nhas created with the wrong fiware-service-path or fiware-service header
The lastNotification should be a recent timestamp - if this is not the case, then the devices\nare not regularly sending data. Remember to unlock the Smart Door and switch on the Smart Lamp
The lastSuccess should match the lastNotification date - if this is not the case \nthen Cygnus is not receiving the subscription properly. Check that the host name\nand port are correct.
Finally, check that the status of the subscription is active - an expired subscription\nwill not fire.
Persisting historic context data using MongoDB technology is relatively simple to configure since\nwe are already using a MongoDB instance to hold data related to the Orion Context Broker and the\nIoT Agent. The MongoDB instance is listening on the standard 27017 port and the overall architecture\ncan be seen below:
![](\"https://fiware.github.io/tutorials.Historic-Context-Flume/img/cygnus-mongo.png\")
mongo-db:\n image: mongo:3.6\n hostname: mongo-db\n container_name: db-mongo\n ports:\n - \"27017:27017\"\n networks:\n - default\n command: --bind_ip_all --smallfiles\ncygnus:\n image: fiware/cygnus-ngsi:latest\n hostname: cygnus\n container_name: fiware-cygnus\n depends_on:\n - mongo-db\n networks:\n - default\n expose:\n - \"5080\"\n ports:\n - \"5051:5051\"\n - \"5080:5080\"\n environment:\n - \"CYGNUS_MONGO_HOSTS=mongo-db:27017\"\n - \"CYGNUS_MONGO_SERVICE_PORT=5051\"\n - \"CYGNUS_LOG_LEVEL=DEBUG\"\n - \"CYGNUS_API_PORT=5080\"\n - \"CYGNUS_SERVICE_PORT=5051\"\nThe cygnus container is listening on two ports:
5051 for notifications from the Orion context broker5080 is exposed purely for tutorial access - so that cUrl or Postman can make provisioning commands\nwithout being part of the same network.The cygnus container is driven by environment variables as shown:
To start the system with a Mongo DB database only, run the following command:
\n./services mongodb\nFor the purpose of this tutorial, we must be monitoring a system where the context is periodically being updated.\nThe dummy IoT Sensors can be used to do this. Open the device monitor page at http://localhost:3000/device/monitor\nand unlock a Smart Door and switch on a Smart Lamp. This can be done by selecting an appropriate the command \nfrom the drop down list and pressing the send button. The stream of measurements coming from the devices can then\nbe seen on the same page:
![](\"https://fiware.github.io/tutorials.Historic-Context/img/door-open.gif\")
To read mongo-db data from the command line, we will need access to the mongo tool run an interactive instance\nof the mongo image as shown to obtain a command line prompt:
docker run -it --network fiware_default --entrypoint /bin/bash mongo\nYou can then log into to the running mongo-db database by using the command line as shown:
mongo --host mongo-db\nTo show the list of available databases, run the statement as shown:
\nshow dbs\nadmin 0.000GB\niotagentul 0.000GB\nlocal 0.000GB\norion 0.000GB\norion-openiot 0.000GB\nsth_openiot 0.000GB\nThe result include two databases admin and local which are set up by default by MongoDB, along with four databases\ncreated by the FIWARE platform. The Orion Context Broker has created two separate database instance for each fiware-service
fiware-service and therefore are held within the orion database,\nwhereas the IoT device entities were created using the openiot fiware-service header and are held separately. The IoT Agent was intialized to hold the IoT sensor data in a separate MongoDB database called iotagentul.As a result of the subscription of Cygnus to Orion Context Broker, a new database has been created called sth_openiot. The default value for a Mongo DB database holding historic context consists of the sth_ prefix followed by the fiware-service header - therefore sth_openiot holds the historic context of the IoT devices.
use sth_openiot\nshow collections\nswitched to db sth_openiot\n\nsth_/_Door:001_Door\nsth_/_Door:001_Door.aggr\nsth_/_Lamp:001_Lamp\nsth_/_Lamp:001_Lamp.aggr\nsth_/_Motion:001_Motion\nsth_/_Motion:001_Motion.aggr\nLooking within the sth_openiot you will see that a series of tables have been created. The names of each table consist\nof the sth_ prefix followed by the fiware-servicepath header followed by the entity id. Two table are created for\neach entity - the .aggr table holds some aggregated data which will be accessed in a later tutorial. The raw data\ncan be seen in the tables without the .aggr suffix.
The historical data can be seen by looking at the data within each table, by default each row will contain the sampled value of a single attribute.
\ndb[\"sth_/_Door:001_Door\"].find().limit(10)\n{ \"_id\" : ObjectId(\"5b1fa48630c49e0012f7635d\"), \"recvTime\" : ISODate(\"2018-06-12T10:46:30.897Z\"), \"attrName\" : \"TimeInstant\", \"attrType\" : \"ISO8601\", \"attrValue\" : \"2018-06-12T10:46:30.836Z\" }\n{ \"_id\" : ObjectId(\"5b1fa48630c49e0012f7635e\"), \"recvTime\" : ISODate(\"2018-06-12T10:46:30.897Z\"), \"attrName\" : \"close_status\", \"attrType\" : \"commandStatus\", \"attrValue\" : \"UNKNOWN\" }\n{ \"_id\" : ObjectId(\"5b1fa48630c49e0012f7635f\"), \"recvTime\" : ISODate(\"2018-06-12T10:46:30.897Z\"), \"attrName\" : \"lock_status\", \"attrType\" : \"commandStatus\", \"attrValue\" : \"UNKNOWN\" }\n{ \"_id\" : ObjectId(\"5b1fa48630c49e0012f76360\"), \"recvTime\" : ISODate(\"2018-06-12T10:46:30.897Z\"), \"attrName\" : \"open_status\", \"attrType\" : \"commandStatus\", \"attrValue\" : \"UNKNOWN\" }\n{ \"_id\" : ObjectId(\"5b1fa48630c49e0012f76361\"), \"recvTime\" : ISODate(\"2018-06-12T10:46:30.836Z\"), \"attrName\" : \"refStore\", \"attrType\" : \"Relationship\", \"attrValue\" : \"Store:001\" }\n{ \"_id\" : ObjectId(\"5b1fa48630c49e0012f76362\"), \"recvTime\" : ISODate(\"2018-06-12T10:46:30.836Z\"), \"attrName\" : \"state\", \"attrType\" : \"Text\", \"attrValue\" : \"CLOSED\" }\n{ \"_id\" : ObjectId(\"5b1fa48630c49e0012f76363\"), \"recvTime\" : ISODate(\"2018-06-12T10:45:26.368Z\"), \"attrName\" : \"unlock_info\", \"attrType\" : \"commandResult\", \"attrValue\" : \" unlock OK\" }\n{ \"_id\" : ObjectId(\"5b1fa48630c49e0012f76364\"), \"recvTime\" : ISODate(\"2018-06-12T10:45:26.368Z\"), \"attrName\" : \"unlock_status\", \"attrType\" : \"commandStatus\", \"attrValue\" : \"OK\" }\n{ \"_id\" : ObjectId(\"5b1fa4c030c49e0012f76385\"), \"recvTime\" : ISODate(\"2018-06-12T10:47:28.081Z\"), \"attrName\" : \"TimeInstant\", \"attrType\" : \"ISO8601\", \"attrValue\" : \"2018-06-12T10:47:28.038Z\" }\n{ \"_id\" : ObjectId(\"5b1fa4c030c49e0012f76386\"), \"recvTime\" : ISODate(\"2018-06-12T10:47:28.081Z\"), \"attrName\" : \"close_status\", \"attrType\" : \"commandStatus\", \"attrValue\" : \"UNKNOWN\" }\nThe usual Mongo-DB query syntax can be used to filter appropriate fields and values. For example to read the rate at which the Motion Sensor with the id=Motion:001_Motion is accumulating, you would make a query as follows:
db[\"sth_/_Motion:001_Motion\"].find({attrName: \"count\"},{_id: 0, attrType: 0, attrName: 0 } ).limit(10)\n{ \"recvTime\" : ISODate(\"2018-06-12T10:46:18.756Z\"), \"attrValue\" : \"8\" }\n{ \"recvTime\" : ISODate(\"2018-06-12T10:46:36.881Z\"), \"attrValue\" : \"10\" }\n{ \"recvTime\" : ISODate(\"2018-06-12T10:46:42.947Z\"), \"attrValue\" : \"11\" }\n{ \"recvTime\" : ISODate(\"2018-06-12T10:46:54.893Z\"), \"attrValue\" : \"13\" }\n{ \"recvTime\" : ISODate(\"2018-06-12T10:47:00.929Z\"), \"attrValue\" : \"15\" }\n{ \"recvTime\" : ISODate(\"2018-06-12T10:47:06.954Z\"), \"attrValue\" : \"17\" }\n{ \"recvTime\" : ISODate(\"2018-06-12T10:47:15.983Z\"), \"attrValue\" : \"19\" }\n{ \"recvTime\" : ISODate(\"2018-06-12T10:47:49.090Z\"), \"attrValue\" : \"23\" }\n{ \"recvTime\" : ISODate(\"2018-06-12T10:47:58.112Z\"), \"attrValue\" : \"25\" }\n{ \"recvTime\" : ISODate(\"2018-06-12T10:48:28.218Z\"), \"attrValue\" : \"29\" }\nTo leave the MongoDB client and leave interactive mode, run the following:
\nexit\nexit\nOnce Cygnus is running, You can check the status by making an HTTP request to the exposed CYGNUS_API_PORT port. \nIf the response is blank, this is usually because Cygnus is not running or is listening on another port.
\n\n","urlObject":{"protocol":"http","path":["v1","version"],"host":["localhost:5080"],"query":[],"variable":[]}},"response":[],"_postman_id":"fe6c77f2-89ff-4721-b42f-dde069494258"},{"name":"Orion - Subscribe to Context Changes","id":"570dfecc-98de-41a2-b869-b60995c2acf1","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"POST","header":[{"key":"Content-Type","value":"application/json"},{"key":"fiware-service","value":"openiot"},{"key":"fiware-servicepath","value":"/"}],"body":{"mode":"raw","raw":"{\n \"description\": \"Notify Cygnus of all context changes\",\n \"subject\": {\n \"entities\": [\n {\n \"idPattern\": \".*\"\n }\n ]\n },\n \"notification\": {\n \"http\": {\n \"url\": \"http://cygnus:5055/notify\"\n }\n },\n \"throttling\": 5\n}"},"url":"http://localhost:1026/v2/subscriptions/","description":"Troubleshooting: What if the response is blank ?
\n\n
\n- To check that a docker container is running try
\n\ndocker ps\nYou should see several containers running. If
\ncygnusis not running, you can restart the containers as necessary.
Once a dynamic context system is up and running, we need to inform Cygnus of changes in context.
\nThis is done by making a POST request to the /v2/subscription endpoint of the Orion Context Broker.
fiware-service and fiware-servicepath headers are used to filter the subscription to only listen to measurements from the attached IoT SensorsidPattern in the request body ensures that Cygnus will be informed of all context data changes.url must match the configured CYGNUS_POSTGRESQL_SERVICE_PORTattrsFormat=legacy is required since Cygnus currently only accepts notifications in the older NGSI v1 format.throttling value defines the rate that changes are sampled.As you can see, the database used to persist context data has no impact on the details of the subscription.It is the same for each database.
\n","urlObject":{"protocol":"http","path":["v2","subscriptions",""],"host":["localhost:1026"],"query":[],"variable":[]}},"response":[],"_postman_id":"570dfecc-98de-41a2-b869-b60995c2acf1"},{"name":"Orion - Check Subscription is working","id":"f2184501-caed-4b0d-9095-ab51fa0c7cef","request":{"method":"GET","header":[{"key":"fiware-service","value":"openiot"},{"key":"fiware-servicepath","value":"/"}],"body":{"mode":"raw","raw":""},"url":"http://localhost:1026/v2/subscriptions/","description":"If a subscription has been created, you can check to see if it is firing by making a GET \nrequest to the /v2/subscriptions endpoint.
Within the notification section of the response, you can see several additional attributes which describe the health of the subscription
If the criteria of the subscription have been met, timesSent should be greater than 0.\nA zero value would indicate that the subject of the subscription is incorrect or the subscription \nhas created with the wrong fiware-service-path or fiware-service header
The lastNotification should be a recent timestamp - if this is not the case, then the devices\nare not regularly sending data. Remember to unlock the Smart Door and switch on the Smart Lamp
The lastSuccess should match the lastNotification date - if this is not the case \nthen Cygnus is not receiving the subscription properly. Check that the host name\nand port are correct.
Finally, check that the status of the subscription is active - an expired subscription\nwill not fire.
To persist historic context data into an alternative database such as PostgreSQL, we will\nneed an additional container which hosts the PostgreSQL server - the default Docker image for this\ndata can be used. The PostgreSQL instance is listening on the standard 5432 port and the overall architecture\ncan be seen below:
![](\"https://fiware.github.io/tutorials.Historic-Context-Flume/img/cygnus-postgres.png\")
We now have a system with two databases, since the MongoDB container is still required \nto hold data related to the Orion Context Broker and the IoT Agent.
\nTo start the system with a PostgreSQL database run the following command:
\n./services postgres\npostgres-db:\n image: postgres:latest\n hostname: postgres-db\n container_name: db-postgres\n expose:\n - \"5432\"\n ports:\n - \"5432:5432\"\n networks:\n - default\n environment:\n - \"POSTGRES_PASSWORD=password\"\n - \"POSTGRES_USER=postgres\"\n - \"POSTGRES_DB=postgres\"\n\nThe postgres-db container is listening on a single port:
5432 is the default port for a PostgreSQL server. It has been exposed so you can also run the pgAdmin4 tool to display database data if you wishThe postgres-db container is driven by environment variables as shown:
cygnus:\n image: fiware/cygnus-ngsi:latest\n hostname: cygnus\n container_name: fiware-cygnus\n networks:\n - default\n depends_on:\n - postgres-db\n expose:\n - \"5080\"\n ports:\n - \"5055:5055\"\n - \"5080:5080\"\n environment:\n - \"CYGNUS_POSTGRESQL_HOST=postgres-db\"\n - \"CYGNUS_POSTGRESQL_PORT=5432\"\n - \"CYGNUS_POSTGRESQL_USER=postgres\"\n - \"CYGNUS_POSTGRESQL_PASS=password\"\n - \"CYGNUS_POSTGRESQL_ENABLE_CACHE=true\"\n - \"CYGNUS_POSTGRESQL_SERVICE_PORT=5055\"\n - \"CYGNUS_LOG_LEVEL=DEBUG\"\n - \"CYGNUS_API_PORT=5080\"\n - \"CYGNUS_SERVICE_PORT=5055\"\nThe cygnus container is listening on two ports:
5055 for notifications from the Orion context broker5080 is exposed purely for tutorial access - so that cUrl or Postman can make provisioning commands\nwithout being part of the same network.The cygnus container is driven by environment variables as shown:
For the purpose of this tutorial, we must be monitoring a system where the context is periodically being updated.\nThe dummy IoT Sensors can be used to do this. Open the device monitor page at http://localhost:3000/device/monitor\nand unlock a Smart Door and switch on a Smart Lamp. This can be done by selecting an appropriate the command \nfrom the drop down list and pressing the send button. The stream of measurements coming from the devices can then\nbe seen on the same page:
To read PostgreSQL data from the command line, we will need access to the postgres client, to do this, run an\ninteractive instance of the postgresql-client image supplying the connection string as shown to obtain a command \nline prompt:
docker run -it --rm --network fiware_default jbergknoff/postgresql-client \\\n postgresql://postgres:password@postgres-db:5432/postgres\nTo show the list of available databases, run the statement as shown:
\n\\list\n Name | Owner | Encoding | Collate | Ctype | Access privileges \n-----------+----------+----------+------------+------------+-----------------------\n postgres | postgres | UTF8 | en_US.utf8 | en_US.utf8 | \n template0 | postgres | UTF8 | en_US.utf8 | en_US.utf8 | =c/postgres +\n | | | | | postgres=CTc/postgres\n template1 | postgres | UTF8 | en_US.utf8 | en_US.utf8 | =c/postgres +\n | | | | | postgres=CTc/postgres\n(3 rows)\nThe result include two template databases template0 and template1 as well as the postgres database setup when the docker container was started.
To show the list of available schemas, run the statement as shown:
\n\\dn\n List of schemas\n Name | Owner \n---------+----------\n openiot | postgres\n public | postgres\n(2 rows)\nAs a result of the subscription of Cygnus to Orion Context Broker, a new schema has been created called openiot. \nThe name of the schema matches the fiware-service header - therefore openiot holds the historic context of the\nIoT devices.
Once running a docker container within the network, it is possible to obtain information about the running\ndatabase.
\nSELECT table_schema,table_name\nFROM information_schema.tables\nWHERE table_schema ='openiot'\nORDER BY table_schema,table_name;\n table_schema | table_name \n--------------+-------------------\n openiot | door_001_door\n openiot | lamp_001_lamp\n openiot | motion_001_motion\n(3 rows)\nThe table_schema matches the fiware-service header supplied with the context data:
To read the data within a table, run a select statement as shown:
\nSELECT * FROM openiot.motion_001_motion limit 10;\n recvtimets | recvtime | fiwareservicepath | entityid | entitytype | attrname | attrtype | attrvalue | attrmd \n---------------+--------------------------+-------------------+------------+------------+-------------+--------------+--------------------------+------------------------------------------------------------------------------\n 1528803005491 | 2018-06-12T11:30:05.491Z | / | Motion:001 | Motion | TimeInstant | ISO8601 | 2018-06-12T11:30:05.423Z | []\n 1528803005491 | 2018-06-12T11:30:05.491Z | / | Motion:001 | Motion | count | Integer | 7 | [{\"name\":\"TimeInstant\",\"type\":\"ISO8601\",\"value\":\"2018-06-12T11:30:05.423Z\"}]\n 1528803005491 | 2018-06-12T11:30:05.491Z | / | Motion:001 | Motion | refStore | Relationship | Store:001 | [{\"name\":\"TimeInstant\",\"type\":\"ISO8601\",\"value\":\"2018-06-12T11:30:05.423Z\"}]\n 1528803035501 | 2018-06-12T11:30:35.501Z | / | Motion:001 | Motion | TimeInstant | ISO8601 | 2018-06-12T11:30:35.480Z | []\n 1528803035501 | 2018-06-12T11:30:35.501Z | / | Motion:001 | Motion | count | Integer | 10 | [{\"name\":\"TimeInstant\",\"type\":\"ISO8601\",\"value\":\"2018-06-12T11:30:35.480Z\"}]\n 1528803035501 | 2018-06-12T11:30:35.501Z | / | Motion:001 | Motion | refStore | Relationship | Store:001 | [{\"name\":\"TimeInstant\",\"type\":\"ISO8601\",\"value\":\"2018-06-12T11:30:35.480Z\"}]\n 1528803041563 | 2018-06-12T11:30:41.563Z | / | Motion:001 | Motion | TimeInstant | ISO8601 | 2018-06-12T11:30:41.520Z | []\n 1528803041563 | 2018-06-12T11:30:41.563Z | / | Motion:001 | Motion | count | Integer | 12 | [{\"name\":\"TimeInstant\",\"type\":\"ISO8601\",\"value\":\"2018-06-12T11:30:41.520Z\"}]\n 1528803041563 | 2018-06-12T11:30:41.563Z | / | Motion:001 | Motion | refStore | Relationship | Store:001 | [{\"name\":\"TimeInstant\",\"type\":\"ISO8601\",\"value\":\"2018-06-12T11:30:41.520Z\"}]\n 1528803047545 | 2018-06-12T11:30:47.545Z | / \nThe usual PostgreSQL query syntax can be used to filter appropriate fields and values. For example to read the rate at which the Motion Sensor with the id=Motion:001_Motion is accumulating, you would make a query as follows:
SELECT recvtime, attrvalue FROM openiot.motion_001_motion WHERE attrname ='count' limit 10;\n recvtime | attrvalue \n--------------------------+-----------\n 2018-06-12T11:30:05.491Z | 7\n 2018-06-12T11:30:35.501Z | 10\n 2018-06-12T11:30:41.563Z | 12\n 2018-06-12T11:30:47.545Z | 13\n 2018-06-12T11:31:02.617Z | 15\n 2018-06-12T11:31:32.718Z | 20\n 2018-06-12T11:31:38.733Z | 22\n 2018-06-12T11:31:50.780Z | 24\n 2018-06-12T11:31:56.825Z | 25\n 2018-06-12T11:31:59.790Z | 26\n(10 rows)\nTo leave the Postgres client and leave interactive mode, run the following:
\n\\q\nYou will then return to the commmand line.
\n","event":[{"listen":"prerequest","script":{"id":"9547319e-f5df-4a3d-9a69-86221f7aeb2f","type":"text/javascript","exec":[""]}},{"listen":"test","script":{"id":"eaf3c847-e1eb-48e2-aadd-35caf0463942","type":"text/javascript","exec":[""]}}],"_postman_id":"6f53fa4a-083c-4378-8e3f-620e1d05eb52"},{"name":"MySQL - Persisting Context","item":[{"name":"Cygnus - Obtain version information","id":"87aee394-9ec5-4f33-b0a0-4e5041551eaa","request":{"method":"GET","header":[],"body":{"mode":"formdata","formdata":[]},"url":"http://localhost:5080/v1/version","description":"Once Cygnus is running, You can check the status by making an HTTP request to the exposed CYGNUS_API_PORT port. \nIf the response is blank, this is usually because Cygnus is not running or is listening on another port.
\n\n","urlObject":{"protocol":"http","path":["v1","version"],"host":["localhost:5080"],"query":[],"variable":[]}},"response":[],"_postman_id":"87aee394-9ec5-4f33-b0a0-4e5041551eaa"},{"name":"Orion - Subscribe to Context Changes","id":"bdae8a37-fdce-4bb3-b341-56c587dfa1bc","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"POST","header":[{"key":"Content-Type","value":"application/json"},{"key":"fiware-service","value":"openiot"},{"key":"fiware-servicepath","value":"/"}],"body":{"mode":"raw","raw":"{\n \"description\": \"Notify Cygnus of all context changes\",\n \"subject\": {\n \"entities\": [\n {\n \"idPattern\": \".*\"\n }\n ]\n },\n \"notification\": {\n \"http\": {\n \"url\": \"http://cygnus:5050/notify\"\n }\n },\n \"throttling\": 5\n}"},"url":"http://localhost:1026/v2/subscriptions/","description":"Troubleshooting: What if the response is blank ?
\n\n
\n- To check that a docker container is running try
\n\ndocker ps\nYou should see several containers running. If
\ncygnusis not running, you can restart the containers as necessary.
Once a dynamic context system is up and running, we need to inform Cygnus of changes in context.
\nThis is done by making a POST request to the /v2/subscription endpoint of the Orion Context Broker.
fiware-service and fiware-servicepath headers are used to filter the subscription to only listen to measurements from the attached IoT SensorsidPattern in the request body ensures that Cygnus will be informed of all context data changes.url must match the configured CYGNUS_MYSQL_SERVICE_PORTattrsFormat=legacy is required since Cygnus currently only accepts notifications in the older NGSI v1 format.throttling value defines the rate that changes are sampled.As you can see, the database used to persist context data has no impact on the details of the subscription. It is the same for each database.
\n","urlObject":{"protocol":"http","path":["v2","subscriptions",""],"host":["localhost:1026"],"query":[],"variable":[]}},"response":[],"_postman_id":"bdae8a37-fdce-4bb3-b341-56c587dfa1bc"},{"name":"Orion - Check Subscription is working","id":"62839dc3-bba3-4ef3-8ed6-f03420ff918b","request":{"method":"GET","header":[{"key":"fiware-service","value":"openiot"},{"key":"fiware-servicepath","value":"/"}],"body":{"mode":"raw","raw":""},"url":"http://localhost:1026/v2/subscriptions/","description":"If a subscription has been created, you can check to see if it is firing by making a GET \nrequest to the /v2/subscriptions endpoint.
Within the notification section of the response, you can see several additional attributes which describe the health of the subscription
If the criteria of the subscription have been met, timesSent should be greater than 0.\nA zero value would indicate that the subject of the subscription is incorrect or the subscription \nhas created with the wrong fiware-service-path or fiware-service header
The lastNotification should be a recent timestamp - if this is not the case, then the devices\nare not regularly sending data. Remember to unlock the Smart Door and switch on the Smart Lamp
The lastSuccess should match the lastNotification date - if this is not the case \nthen Cygnus is not receiving the subscription properly. Check that the host name\nand port are correct.
Finally, check that the status of the subscription is active - an expired subscription\nwill not fire.
Similarly, to persisting historic context data into MySQL, we will again\nneed an additional container which hosts the MySQL server, once again the default Docker image for this\ndata can be used. The MySQL instance is listening on the standard 3306 port and the overall architecture\ncan be seen below:
![](\"https://fiware.github.io/tutorials.Historic-Context-Flume/img/cygnus-mysql.png\")
Once again we have a system with two databases, since the MongoDB container is still required \nto hold data related to the Orion Context Broker and the IoT Agent.
\nmysql-db:\n restart: always\n image: mysql:5.7\n hostname: mysql-db\n container_name: db-mysql\n expose:\n - \"3306\"\n ports:\n - \"3306:3306\"\n networks:\n - default\n environment:\n - \"MYSQL_ROOT_PASSWORD=123\"\n - \"MYSQL_ROOT_HOST=%\"\nThe mysql-db container is listening on a single port:
3306 is the default port for a MySQL server. It has been exposed so you can also run other database tools to display data if you wishThe mysql-db container is driven by environment variables as shown:
cygnus:\n image: fiware/cygnus-ngsi:latest\n hostname: cygnus\n container_name: fiware-cygnus\n networks:\n - default\n depends_on:\n - mysql-db\n expose:\n - \"5080\"\n ports:\n - \"5080:5080\"\n environment:\n - \"CYGNUS_MYSQL_HOST=mysql-db\"\n - \"CYGNUS_MYSQL_PORT=3306\"\n - \"CYGNUS_MYSQL_USER=root\"\n - \"CYGNUS_MYSQL_PASS=123\"\n - \"CYGNUS_MYSQL_SERVICE_PORT=5050\"\n - \"CYGNUS_LOG_LEVEL=DEBUG\"\n - \"CYGNUS_API_PORT=5080\"\n - \"CYGNUS_SERVICE_PORT=5050\"\nThe cygnus container is listening on two ports:
5050 for notifications from the Orion context broker5080 is exposed purely for tutorial access - so that cUrl or Postman can make provisioning commands\nwithout being part of the same network.The cygnus container is driven by environment variables as shown:
To start the system with a MySQL database run the following command:
\n./services mysql\nFor the purpose of this tutorial, we must be monitoring a system where the context is periodically being updated.\nThe dummy IoT Sensors can be used to do this. Open the device monitor page at http://localhost:3000/device/monitor\nand unlock a Smart Door and switch on a Smart Lamp. This can be done by selecting an appropriate the command \nfrom the drop down list and pressing the send button. The stream of measurements coming from the devices can then\nbe seen on the same page:
To read MySQL data from the command line, we will need access to the mysql client, to do this, run an\ninteractive instance of the mysql image supplying the connection string as shown to obtain a command \nline prompt:
docker exec -it db-mysql mysql -h mysql-db -P 3306 -u root -p123\nTo show the list of available databases, run the statement as shown:
\nSHOW DATABASES;\n+--------------------+\n| Database |\n+--------------------+\n| information_schema |\n| mysql |\n| openiot |\n| performance_schema |\n| sys |\n+--------------------+\n5 rows in set (0.00 sec)\nTo show the list of available schemas, run the statement as shown:
\nSHOW SCHEMAS;\n+--------------------+\n| Database |\n+--------------------+\n| information_schema |\n| mysql |\n| openiot |\n| performance_schema |\n| sys |\n+--------------------+\n5 rows in set (0.00 sec)\nAs a result of the subscription of Cygnus to Orion Context Broker, a new schema has been created called openiot. \nThe name of the schema matches the fiware-service header - therefore openiot holds the historic context of the\nIoT devices.
Once running a docker container within the network, it is possible to obtain information about the running\ndatabase.
\nSHOW tables FROM openiot;\n table_schema | table_name \n--------------+-------------------\n openiot | door_001_door\n openiot | lamp_001_lamp\n openiot | motion_001_motion\n(3 rows)\nThe table_schema matches the fiware-service header supplied with the context data:
To read the data within a table, run a select statement as shown:
\nSELECT * FROM openiot.Motion_001_Motion limit 10;\n+---------------+-------------------------+-------------------+------------+------------+-------------+--------------+--------------------------+------------------------------------------------------------------------------+\n| recvTimeTs | recvTime | fiwareServicePath | entityId | entityType | attrName | attrType | attrValue | attrMd |\n+---------------+-------------------------+-------------------+------------+------------+-------------+--------------+--------------------------+------------------------------------------------------------------------------+\n| 1528804397955 | 2018-06-12T11:53:17.955 | / | Motion:001 | Motion | TimeInstant | ISO8601 | 2018-06-12T11:53:17.923Z | [] |\n| 1528804397955 | 2018-06-12T11:53:17.955 | / | Motion:001 | Motion | count | Integer | 3 | [{\"name\":\"TimeInstant\",\"type\":\"ISO8601\",\"value\":\"2018-06-12T11:53:17.923Z\"}] |\n| 1528804397955 | 2018-06-12T11:53:17.955 | / | Motion:001 | Motion | refStore | Relationship | Store:001 | [{\"name\":\"TimeInstant\",\"type\":\"ISO8601\",\"value\":\"2018-06-12T11:53:17.923Z\"}] |\n| 1528804403954 | 2018-06-12T11:53:23.954 | / | Motion:001 | Motion | TimeInstant | ISO8601 | 2018-06-12T11:53:23.928Z | [] |\n| 1528804403954 | 2018-06-12T11:53:23.954 | / | Motion:001 | Motion | count | Integer | 5 | [{\"name\":\"TimeInstant\",\"type\":\"ISO8601\",\"value\":\"2018-06-12T11:53:23.928Z\"}] |\n| 1528804403954 | 2018-06-12T11:53:23.954 | / | Motion:001 | Motion | refStore | Relationship | Store:001 | [{\"name\":\"TimeInstant\",\"type\":\"ISO8601\",\"value\":\"2018-06-12T11:53:23.928Z\"}] |\n| 1528804409970 | 2018-06-12T11:53:29.970 | / | Motion:001 | Motion | TimeInstant | ISO8601 | 2018-06-12T11:53:29.948Z | [] |\n| 1528804409970 | 2018-06-12T11:53:29.970 | / | Motion:001 | Motion | count | Integer | 7 | [{\"name\":\"TimeInstant\",\"type\":\"ISO8601\",\"value\":\"2018-06-12T11:53:29.948Z\"}] |\n| 1528804409970 | 2018-06-12T11:53:29.970 | / | Motion:001 | Motion | refStore | Relationship | Store:001 | [{\"name\":\"TimeInstant\",\"type\":\"ISO8601\",\"value\":\"2018-06-12T11:53:29.948Z\"}] |\n| 1528804446083 | 2018-06-12T11:54:06.83 | / | Motion:001 | Motion | TimeInstant | ISO8601 | 2018-06-12T11:54:06.062Z | [] |\n+---------------+-------------------------+-------------------+------------+------------+-------------+--------------+--------------------------+------------------------------------------------------------------------------+ \nThe usual MySQL query syntax can be used to filter appropriate fields and values. For example to read the rate at which the Motion Sensor with the id=Motion:001_Motion is accumulating, you would make a query as follows:
SELECT recvtime, attrvalue FROM openiot.Motion_001_Motion WHERE attrname ='count' LIMIT 10;\n+-------------------------+-----------+\n| recvtime | attrvalue |\n+-------------------------+-----------+\n| 2018-06-12T11:53:17.955 | 3 |\n| 2018-06-12T11:53:23.954 | 5 |\n| 2018-06-12T11:53:29.970 | 7 |\n| 2018-06-12T11:54:06.83 | 12 |\n| 2018-06-12T11:54:12.132 | 13 |\n| 2018-06-12T11:54:24.177 | 14 |\n| 2018-06-12T11:54:36.196 | 16 |\n| 2018-06-12T11:54:42.195 | 18 |\n| 2018-06-12T11:55:24.300 | 23 |\n| 2018-06-12T11:55:30.350 | 25 |\n+-------------------------+-----------+\n10 rows in set (0.00 sec)\nTo leave the MySQL client and leave interactive mode, run the following:
\n\\q\nYou will then return to the commmand line.
\n","event":[{"listen":"prerequest","script":{"id":"0a433918-9a68-4cbe-9bdc-031270322304","type":"text/javascript","exec":[""]}},{"listen":"test","script":{"id":"db11ec7d-1bde-4317-8318-db7b0ebf5c61","type":"text/javascript","exec":[""]}}],"_postman_id":"9d1b2b75-bf06-433c-9c46-b56e144dd8ca"},{"name":"Multi-Agent Persisting to Multiple Databases","item":[{"name":"Cygnus - Obtain version information","id":"6e2b6393-d1fe-45eb-93a3-aa79b9761132","request":{"method":"GET","header":[],"body":{"mode":"formdata","formdata":[]},"url":"http://localhost:5080/v1/version","description":"Once Cygnus is running, You can check the status by making an HTTP request to the exposed CYGNUS_API_PORT port. \nIf the response is blank, this is usually because Cygnus is not running or is listening on another port.
\n\n","urlObject":{"protocol":"http","path":["v1","version"],"host":["localhost:5080"],"query":[],"variable":[]}},"response":[],"_postman_id":"6e2b6393-d1fe-45eb-93a3-aa79b9761132"},{"name":"Orion - Subscribe to Context Changes","id":"250cd6ca-9ee6-4cbe-9fc1-9e097126fca0","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"POST","header":[{"key":"Content-Type","value":"application/json"},{"key":"fiware-service","value":"openiot"},{"key":"fiware-servicepath","value":"/"}],"body":{"mode":"raw","raw":"{\n \"description\": \"Notify Cygnus of all context changes for MySQL on port 5050\",\n \"subject\": {\n \"entities\": [\n {\n \"idPattern\": \".*\"\n }\n ]\n },\n \"notification\": {\n \"http\": {\n \"url\": \"http://cygnus:5050/notify\"\n }\n },\n \"throttling\": 5\n}"},"url":"http://localhost:1026/v2/subscriptions/","description":"Troubleshooting: What if the response is blank ?
\n\n
\n- To check that a docker container is running try
\n\ndocker ps\nYou should see several containers running. If
\ncygnusis not running, you can restart the containers as necessary.
Once a dynamic context system is up and running, we need to inform Cygnus of changes in context.
\nThis is done by making a POST request to the /v2/subscription endpoint of the Orion Context Broker.
fiware-service and fiware-servicepath headers are used to filter the subscription to only listen to measurements from the attached IoT SensorsidPattern in the request body ensures that Cygnus will be informed of all context data changes.attrsFormat=legacy is required since Cygnus currently only accepts notifications in the older NGSI v1 format.throttling value defines the rate that changes are sampled.When running in multi-agent mode, the notification url for each subscription must match the defaults for the given database.
The default port mapping can be seen below:
\nSince this subscription is using port 5050 the context data will eventually be persisted to the MySQL database.
If a subscription has been created, you can check to see if it is firing by making a GET \nrequest to the /v2/subscriptions endpoint.
Within the notification section of the response, you can see several additional attributes which describe the health of the subscription
If the criteria of the subscription have been met, timesSent should be greater than 0.\nA zero value would indicate that the subject of the subscription is incorrect or the subscription \nhas created with the wrong fiware-service-path or fiware-service header
The lastNotification should be a recent timestamp - if this is not the case, then the devices\nare not regularly sending data. Remember to unlock the Smart Door and switch on the Smart Lamp
The lastSuccess should match the lastNotification date - if this is not the case \nthen Cygnus is not receiving the subscription properly. Check that the host name\nand port are correct.
Finally, check that the status of the subscription is active - an expired subscription\nwill not fire.
It is also possible to configure Cygnus to populate multiple databases simultaneously. We can combine\nthe architecture from the three previous examples and configure cygnus to listen on multiple ports
\n![](\"https://fiware.github.io/tutorials.Historic-Context-Flume/img/cygnus-all-three.png\")
We now have a system with three databases, PostgreSQL and MySQL for data persistence and MongoDB \nfor both data persistence and holding data related to the Orion Context Broker and the IoT Agent.
\ncygnus:\n image: fiware/cygnus-ngsi:latest\n hostname: cygnus\n container_name: fiware-cygnus\n depends_on:\n - mongo-db\n - mysql-db\n - postgres-db\n networks:\n - default\n expose:\n - \"5080\"\n - \"5081\"\n - \"5084\"\n ports:\n - \"5050:5050\"\n - \"5051:5051\"\n - \"5054:5054\"\n - \"5080:5080\"\n - \"5081:5081\"\n - \"5084:5084\"\n environment:\n - \"CYGNUS_MULTIAGENT=true\"\n - \"CYGNUS_POSTGRESQL_HOST=postgres-sb\"\n - \"CYGNUS_POSTGRESQL_PORT=5432\"\n - \"CYGNUS_POSTGRESQL_USER=postgres\" \n - \"CYGNUS_POSTGRESQL_PASS=password\" \n - \"CYGNUS_POSTGRESQL_ENABLE_CACHE=true\"\n - \"CYGNUS_MYSQL_HOST=mysql-db\"\n - \"CYGNUS_MYSQL_PORT=3306\"\n - \"CYGNUS_MYSQL_USER=root\" \n - \"CYGNUS_MYSQL_PASS=123\" \n - \"CYGNUS_LOG_LEVEL=DEBUG\"\nIn multi-agent mode, the cygnus container is listening on multiple ports:
5050-5055 for notifications from the Orion context broker5080-5085 are exposed purely for tutorial access - so that cUrl or Postman can make provisioning commands\nwithout being part of the same network.The default port mapping can be seen below:
\nSince we are not persisting CKAN, HDFS or CartoDB data, there is no need to open those ports.
\nThe cygnus container is driven by environment variables as shown:
To start the system with multiple databases run the following command:
\n./services multiple\nFor the purpose of this tutorial, we must be monitoring a system where the context is periodically being updated.\nThe dummy IoT Sensors can be used to do this. Open the device monitor page at http://localhost:3000/device/monitor\nand unlock a Smart Door and switch on a Smart Lamp. This can be done by selecting an appropriate the command \nfrom the drop down list and pressing the send button. The stream of measurements coming from the devices can then\nbe seen on the same page:
Once Cygnus is running, You can check the status by making an HTTP request to the exposed CYGNUS_API_PORT port. \nIf the response is blank, this is usually because Cygnus is not running or is listening on another port.
\n\n","urlObject":{"protocol":"http","path":["v1","version"],"host":["localhost:5080"],"query":[],"variable":[]}},"response":[],"_postman_id":"387b284b-b8a1-4ce9-8631-e6014b06319f"},{"name":"Orion - Subscribe to Context Changes","id":"f02788dd-897d-4736-96db-00e11f9b520e","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"POST","header":[{"key":"Content-Type","value":"application/json"},{"key":"fiware-service","value":"openiot"},{"key":"fiware-servicepath","value":"/"}],"body":{"mode":"raw","raw":"{\n \"description\": \"Notify Cygnus of all context changes for HDFS on port 5053\",\n \"subject\": {\n \"entities\": [\n {\n \"idPattern\": \".*\"\n }\n ]\n },\n \"notification\": {\n \"http\": {\n \"url\": \"http://cygnus:5053/notify\"\n }\n },\n \"throttling\": 5\n}"},"url":"http://localhost:1026/v2/subscriptions/","description":"Troubleshooting: What if the response is blank ?
\n\n
\n- To check that a docker container is running try
\n\ndocker ps\nYou should see several containers running. If
\ncygnusis not running, you can restart the containers as necessary.
Once a dynamic context system is up and running, we need to inform Cygnus of changes in context.
\nThis is done by making a POST request to the /v2/subscription endpoint of the Orion Context Broker.
fiware-service and fiware-servicepath headers are used to filter the subscription to only listen to measurements from the attached IoT SensorsidPattern in the request body ensures that Cygnus will be informed of all context data changes.attrsFormat=legacy is required since Cygnus currently only accepts notifications in the older NGSI v1 format.throttling value defines the rate that changes are sampled.When running in multi-agent mode, the notification url for each subscription must match the defaults for the given database.
The default port mapping can be seen below:
\nSince this subscription is using port 5050 the context data will eventually be persisted to the MySQL database.
If a subscription has been created, you can check to see if it is firing by making a GET \nrequest to the /v2/subscriptions endpoint.
Within the notification section of the response, you can see several additional attributes which describe the health of the subscription
If the criteria of the subscription have been met, timesSent should be greater than 0.\nA zero value would indicate that the subject of the subscription is incorrect or the subscription \nhas created with the wrong fiware-service-path or fiware-service header
The lastNotification should be a recent timestamp - if this is not the case, then the devices\nare not regularly sending data. Remember to unlock the Smart Door and switch on the Smart Lamp
The lastSuccess should match the lastNotification date - if this is not the case \nthen Cygnus is not receiving the subscription properly. Check that the host name\nand port are correct.
Finally, check that the status of the subscription is active - an expired subscription\nwill not fire.
It is also possible to configure Cygnus to populate multiple databases simultaneously. We can combine\nthe architecture from the three previous examples and configure cygnus to listen on multiple ports
\n
We now have a system with three databases, PostgreSQL and MySQL for data persistence and MongoDB \nfor both data persistence and holding data related to the Orion Context Broker and the IoT Agent.
\ncygnus:\n image: fiware/cygnus-ngsi:latest\n hostname: cygnus\n container_name: fiware-cygnus\n depends_on:\n - mongo-db\n - mysql-db\n - postgres-db\n networks:\n - default\n expose:\n - \"5080\"\n - \"5081\"\n - \"5084\"\n ports:\n - \"5050:5050\"\n - \"5051:5051\"\n - \"5054:5054\"\n - \"5080:5080\"\n - \"5081:5081\"\n - \"5084:5084\"\n environment:\n - \"CYGNUS_MULTIAGENT=true\"\n - \"CYGNUS_POSTGRESQL_HOST=postgres-sb\"\n - \"CYGNUS_POSTGRESQL_PORT=5432\"\n - \"CYGNUS_POSTGRESQL_USER=postgres\" \n - \"CYGNUS_POSTGRESQL_PASS=password\" \n - \"CYGNUS_POSTGRESQL_ENABLE_CACHE=true\"\n - \"CYGNUS_MYSQL_HOST=mysql-db\"\n - \"CYGNUS_MYSQL_PORT=3306\"\n - \"CYGNUS_MYSQL_USER=root\" \n - \"CYGNUS_MYSQL_PASS=123\" \n - \"CYGNUS_LOG_LEVEL=DEBUG\"\nIn multi-agent mode, the cygnus container is listening on multiple ports:
5050-5055 for notifications from the Orion context broker5080-5085 are exposed purely for tutorial access - so that cUrl or Postman can make provisioning commands\nwithout being part of the same network.The default port mapping can be seen below:
\nSince we are not persisting CKAN, HDFS or CartoDB data, there is no need to open those ports.
\nThe cygnus container is driven by environment variables as shown:
To start the system with multiple databases run the following command:
\n./services multiple\nFor the purpose of this tutorial, we must be monitoring a system where the context is periodically being updated.\nThe dummy IoT Sensors can be used to do this. Open the device monitor page at http://localhost:3000/device/monitor\nand unlock a Smart Door and switch on a Smart Lamp. This can be done by selecting an appropriate the command \nfrom the drop down list and pressing the send button. The stream of measurements coming from the devices can then\nbe seen on the same page: