{"id":1186,"date":"2019-06-27T00:00:00","date_gmt":"2019-06-27T00:00:00","guid":{"rendered":"https:\/\/azure.microsoft.com\/blog\/leveraging-complex-data-to-build-advanced-search-applications-with-azure-search"},"modified":"2025-06-24T23:02:34","modified_gmt":"2025-06-25T06:02:34","slug":"leveraging-complex-data-to-build-advanced-search-applications-with-azure-search","status":"publish","type":"post","link":"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-complex-data-to-build-advanced-search-applications-with-azure-search\/","title":{"rendered":"Leveraging complex data to build advanced search applications with Azure Search"},"content":{"rendered":"\n

Data is rarely simple. Not every piece of data we have can fit nicely into a single Excel worksheet of rows and columns. Data has many diverse relationships such as the multiple locations and phone numbers for a single customer or multiple authors and genres of a single book. Of course, relationships typically are even more complex than this, and as we start to leverage AI to understand our data the additional learnings we get only add to the complexity of relationships. For that reason, expecting customers to have to flatten the data so it can be searched and explored is often unrealistic. We heard this often and it quickly became our number one most requested Azure Search feature<\/a>. Because of this we were excited to announce the general availability of complex types support in Azure Search. In this post, I want to take some time to explain what complex types adds to Azure Search and the kinds of things you can build using this capability. <\/p>\n\n\n\n

Azure Search is a platform as a service that helps developers create their own cloud search solutions.<\/p>\n\n\n\n

What is complex data?<\/h2>\n\n\n\n

Complex data consists of data that includes hierarchical or nested substructures that do not break down neatly into a tabular rowset. For example a book with multiple authors, where each author can have multiple attributes, can\u2019t be represented as a single row of data unless there is a way to model the authors as a collection of objects. Complex types provide this capability, and they can be used when the data cannot be modeled in simple field structures such as strings or integers.<\/p>\n\n\n\n

Complex types applicability<\/h2>\n\n\n\n

At Microsoft Build 2019,  we demonstrated how complex types could be leveraged to build out an effective search application<\/a>. In the session we looked at the Travel Stack Exchange site, one of the many online communities supported by StackExchange.<\/p>\n\n\n\n

The StackExchange data was modeled in a JSON structure to allow easy ingestion it into Azure Search. If we look at the first post made to this site and focus on the first few fields, we see that all of them can be modeled using simple datatypes, including tags which can be modeled as a collection<\/a>, or array of strings.<\/p>\n\n\n

\n{\n   \"id\": \"1\",\n    \"CreationDate\": \"2011-06-21T20:19:34.73\",\n    \"Score\": 8,\n    \"ViewCount\": 462,\n    \"BodyHTML\": \"\nMy fianc\u00e9e and I are looking for a good Caribbean cruise in October and were wondering which\n    \"Body\": \"my fianc\u00e9e and i are looking for a good caribbean cruise in october and were wondering which islands\n    \"OwnerUserId\": 9,\n    \"LastEditorUserId\": 101,\n    \"LastEditDate\": \"2011-12-28T21:36:43.91\",\n    \"LastActivityDate\": \"2012-05-24T14:52:14.76\",\n    \"Title\": \"What are some Caribbean cruises for October?\",\n    \"Tags\": [\n        \"caribbean\",\n        \"cruising\",\n        \"vacations\"\n    ],\n    \"AnswerCount\": 4,\n    \"CommentCount\": 4,\n    \"CloseDate\": \"0001-01-01T00:00:00\",\u200b\n<\/pre><\/div>\n\n\n
However, as we look further down this dataset we see that the data quickly gets more complex and cannot be mapped into a flat structure. For example, there can be numerous comments and answers associated with a single document.\u00a0 Even votes is defined here as a complex type (although technically it could have been flattened, but that would add work to transform the data).<\/p>\n\n\n
\n\"CloseDate\": \"0001-01-01T00:00:00\",\n    \"Comments\": [\n        {\n            \"Score\": 0,\n            \"Text\": \"To help with the cruise line question: Where are you located? My wife and I live in New Orlea\n            \"CreationDate\": \"2011-06-21T20:25:14.257\",\n           \"UserId\": 12\n        },\n        {\n            \"Score\": 0,\n            \"Text\": \"Toronto, Ontario. We can fly out of anywhere though.\",\n            \"CreationDate\": \"2011-06-21T20:27:35.3\",\n            \"UserId\": 9\n        },\n        {\n            \"Score\": 3,\n            \"Text\": \"\"Best\" for what?  Please read [this page](\n            \"UserId\": 20\n        },\n        {\n            \"Score\": 2,\n            \"Text\": \"What do you want out of a cruise? To relax on a boat? To visit islands? Culture? Adventure?\n            \"CreationDate\": \"2011-06-24T05:07:16.643\",\n            \"UserId\": 65\n        }\n    ],\n    \"Votes\": {\n        \"UpVotes\": 10,\n        \"DownVotes\": 2\n    },\n    \"Answers\": [\n        {\n            \"IsAcceptedAnswer\": \"True\",\n            \"Body\": \"This is less than an answer, but more than a comment\u2026nnA large percentage of your travel b\n            \"Score\": 7,\n            \"CreationDate\": \"2011-06-24T05:12:01.133\",\n            \"OwnerUserId\": 74\n<\/pre><\/div>\n\n\n
All of this data is important to the search experience. For example, you might want to:<\/p>\n\n\n\n