Service Fabric IoT Sample
This sample project demonstrates a multi-tenant IoT solution using Azure IoT Hub for device message ingress and Azure Service Fabric for device message access and processing.
- Set up your Service Fabric development environment.
- Create an IoT Hub in Azure or use an existing IoT Hub in your Azure subscription that is not currently being used in a production application. If you're creating a new IoT Hub to run the sample, you can simply use the F1 - Free tier under pricing and scale tier in the Azure portal.
- Make sure you have a local cluster running
- Open a PowerShell window and CD to
- Connect to your cluster using
View application traces
- Open the solution in Visual Studio.
- Open the Diagnostics Event viewer: View -> Other Windows -> Diagnostic events
- In the Diagnostics Event viewer, click the Configuration button with the gear icon, and replace the existing ETW providers with the following ETW providers, then click "Apply."
Microsoft-Iot.Ingestion.RouterService Microsoft-IoT.Admin.WebService Microsoft-IoT.Tenant.WebService Microsoft-IoT.Tenant.DataService Microsoft-ServiceFabric-Services
- Once the application deployment has completed, go to
http://localhost:8081/iotin a web browser to access the admin web UI.
- Using the admin UI, create an ingestion application. Give it any name, your [IoT Hub connection string], and click "Add."(https://azure.microsoft.com/documentation/articles/iot-hub-csharp-csharp-getstarted/#create-an-iot-hub).
- Using the admin UI, create a tenant application. Give it any name, any number of data service partitions, 1 web service instance if running locally, or -1 if running it Azure, and click "Add."
- Once the tenant application is created, click the "Web portal" link to see the tenant's dashboard. Note: It may take a minute for the web portal to become available.
- Run the simple device emulator that's included with the sample under
- Open the solution in Visual Studio 2015.
- Set the Iot.DeviceEmulator project as the start-up project and press F5 or ctrl+F5 to run it.
- Follow the instructions in the command prompt to register devices with IoT Hub and send messages to the tenant application created in step 3.
- Open a PowerShell window and CD to
In this example, the system allows an adminstrator to add any number of "tenants" to the system to consume messages from device field gateways through any number of IoT Hub instances. Tenants can view their devices and device messages through a Web UI. Messages sent from devices are expected to include a tenant name and device ID for the message ingestion application to determine which tenant to send the message to.
Patterns demonstrated in this sample
- Reading messages from IoT Hub with EventHubReceiver. A partitioned stateful Service Fabric service provides a simple and intuitive way to read from IoT Hub partitions by simply mapping stateful service partitions to IoT Hub partitions one-to-one. This approach does not require any addition coordination or leasing between IoT Hub readers. Service Fabric manages creation, placement, availability, and scaling of the stateful service partitions. A Reliable Collection is used in each partition to keep track of the position, or offset in the IoT Hub event stream.
- Multi-tenancy using dynamically-created named application instances. An administrative application uses the Service Fabric management APIs to create a new named application instance for each new tenant, so that each tenant gets their own instance of the message storing and processing service, isolated from other tenants.
- Service-to-service communication using HTTP with ASP.NET Core. Services expose HTTP endpoints to communicate with other services.
This example makes use of several Azure products: - IoT Hub for device management and device message ingress. - Service Fabric hosts the message processing applications. - Azure Storage (optional) can optionally be used for long-term message storage, but is not shown in this example.
The solution is composed of three separate Service Fabric applications, each with their own set of services:
Used by an adminstrator to create instances of the Ingestion Application and Tenant Application. - Web Service: The only service in this application, the web service is a stateless ASP.NET Core service that presents a management UI. API controllers perform Service Fabric management operations using
An instance of this application connects to an IoT Hub, reads device events, and forwards data to the tenant identified in the device event message. - Router Service: The only service in this application, the router service is the stateful partitioned service that connects to IoT Hub and forwards device messages to the appropriate tenant application.
#### Tenant Application A tenant is a user of the system. The system can have multiple tenants. Device event data flows into tenant applications for viewing and processing. - Data Service: A stateful service that holds the most recent device message for a tenant. This service is partitioned so that tenants with a large number of devices can scale horizontally to meet their requirements. - Web Service: A stateless ASP.NET Core service that presents a UI for the tenant to see devices and their most recent messages.
This sample project does not create instances of each application during deployment time. The project is designed to create new application instances at runtime through the Admin UI. In order to create application instances at runtime, the application types must be registered at deployment time. A fresh deployment of this sample looks like this:
Note that only the IoTAdminApplicationType has a named instance running. The other two application types are registered, but no named application instances are created by default. The web UI in the admin application is used to dynamicall create named instances of the other two applications.