Automatic release created from build 20201111-4
Work in this release
Updates applicable to the Azure API for FHIR
4698f7b260 - Implements _include and _revinclude for Cosmos DB (#1426)
With this release we now support _include and _revinclude on CosmosDB. This does not include support for _include:iterate or _revinclude:iterate.
4ce798c5f8 - Avoid returning empty search bundles with next links (#1439)
There are several situations in which Cosmos DB will return an empty page of results with a continuation token. It could be because the query had to halt because of RU exhaustion, because the query had not completed after 5 seconds, or because the SDK executed the query on only one of several physical partitions. Up until now, we simply returned the first page of results that the SDK gave us, but customers have rightly complained that this is both surprising behavior and suboptimal (when would you want an empty page with a next link?) .
In this PR, we attempt to fill up a bundle with at least half of the the items requested. We give up after 30s or if we get a 429, in which case we return whatever we had accumulated. If the _count parameter is specified, the bundle will not have more items than specified. If omitted, bundles may have up to 14 entries, up from the usual default of 10 if the first page is filled up.
At the moment, we are not executing cross-partition queries in parallel.
a515a281f3 - Remove feature flags for conditional update and conditional create. (#1416)
- Addresses Issue #813
ce614ed6cb - Add underlying parsing error to meassage. (#1417)
17267d4cc6 - Remove scope as Reindex job property (#1405)
Initial design allowed an end user to specify a scope of resources to reindex. This design was updated to use the url, i.e. //server//id to define a specific scope. Which is also more inline with the FHIR spec.
5d35cdaf53 - Improve error handling for bad continuation tokens, search values. (#1367)
Improves handling for malformed SQL and Cosmos DB continuation tokens, and improves error handling when parsing search values. Also avoids being over broad with our error handling. For instance, ArgumentExceptions, like those raised in EnsureArg calls, would be translated to 400 response codes instead of 500.
fe54633817 - Escape string search values. (#1406)
- Ensures that strings get escaped before we perform search on them.
- Addresses issue #1389
4e8381d5c3 - Add "POST" search rerouting middleware. (#1414)
- Adds middleware which reroute all "post" search requests to "get" searches.
- Addresses Issue #1115
a0b1413580 - Make UpdateSearchParameterHashMap thread-safe by using ConcurrentDictionary (#1368)
- Updated code to use a ConcurrentDictionary to store _resourceTypeSearchParameterHashMap in SearchParameterDefinitionManager. This will make sure that the calls to UpdateSearchParameterHashMap is thread-safe.
- Addresses Issue #1353
Updates applicable to open-source only
6b91f433bd - Fixed search by _id + reference (#1425)
- Fixed Normalized Predicate Reorderer to sort _id expression first.
- Addresses Issue #1423
2db2acd2df - Refactor supported sorting validation (#1437)
- Introduces ISortingValidator, which is called from SearchOptionsFactory, to provide consistent validation of requested search sortings
- When a sorting is not supported, adds an warning OperationOutcome to the bundle.
- Simplifies next/self link logic for bundles by normalizing _sort parameter based on actual sort order applied.
- Fixes a memory leak in SqlServerSearchService related to supported sorting parameters
1cb5628235 - Introduce solution filter for R4 (#1432)
Solution filters allow specifying a subset of projects in a solution file, resulting in faster solution loading, building, and test runs. This change introduces an R4.slnf file that excludes projects related to STU3 and R5. For developer tasks that do not involve FHIR version-specific behavior, this filtered solution should improve productivity.
f8faa27304 - Reorder background workers (#1429)
- Fixes the issue on server startup when the database does not exists.
5bde6c861f - Minor updates/suggestions to the Helm chart (#1322)
- Added registry name config and removed service account
- Allow configuring pod- and container security context
- Added support for Kubernetes ingress v1 to Helm chart
f4c3bb98ed - Feature/iterate cyclic unsupported (#1391)
- This PR was a continuate of #1314 and details are in PR on the two cases it focuses on.
- Addresses Issue #1313
8091d16e06 - Add support for composite search with Or conditions (#1399)
- Add support for composite search with or conditions and tests for that.
- Addresses Issue #814
9d72598697 - Fix _include query only containing denormalized predicates (#1370)
- Fixes a regression introduced by yours truly, which broke simple _include searches
- Addresses Issue #1342
40cda490a2 - Implements SQL search parameter status data layer. (#1430)
- Creates a new schema version and adds a SQL service to track search parameter status info in the SQL database (PR #1144)
- Adds the stored search parameter status info to the existing dbo.SearchParam table (PR #1169)
- Updates service registration to support the new SQL service (PR #1187)
- Removes "registry" from search parameter status class naming (PR #1189)
- Makes the columns added to dbo.SearchParam nullable (#1219)
- Handles schema upgrade notifications (#1233)
- Refactors how SqlServerFhirModel starts up to handle new dependencies and initialization requirements (#1374)
Some refactoring/setup has already been merged into master to enable these changes:
- SqlServerModelInitializer was removed from the healthcare-shared-components repo (PR #50)
- SchemaUpgradeRunner and SchemaJobWorker were modified to fire notifications on schema upgrade (PR #87 and PR #92)
- SqlServerFhirModel was refactored to no longer rely on the SqlServerModelInitializer (PR #1072)
Test Updates
ca702000c1 - Disable Crucible test (#1411)
- Disabling the Crucible tests that run in CI and cause instabilities.
- See #1410
8e4965542f - Improve E2E test stability (#1403)
- Preserve session tokens across test classes, so that we can read our own writes. This is important for the (definitely suboptimal) approach we take of deleting all existing patients when initializing test class.
- Changed the DeleteAllResources implementation to follow continuation tokens. With Cosmos, you can get an empty bundle with a continuation token.
- Added retrying when we get a 429.
- Changed HistoryTests to use an idempotent create via PUT calls instead of POST. With POST, in the event of a retry because of a network failure, we could end up with several resources being created when we intended to just have one.
Environment changes
04a3bf9c94 - Disable automatic PR builds on the remove environment pipeline (#1325)
e4ee1047d1 - Delete cleanup.yml (#1420)
- The cleanup action won't work until we are able to pass parameters to the DevOps job.
Documentation and Process Updates
63d3bb4ad1 - Add export requirements for deployment (#1377)
Includes updated text that if export is set to true, the person deploying the service needs to have contributor access at the subscription level. If this is not the case, export can be set to false and setup later.
ecd2ea1c0c - Add referenece to health architectures in readme (#1393)
Package Updates
d314e224d2 - Updates package 'prometheus-net.AspNetCore' to version '4.0.0' (#1435)
4ba2a6b6f1 - Updates package 'Microsoft.NET.Test.Sdk' to version '16.7.1' (#1214)
0b93931ad1 - Updates package 'selenium.chrome.webdriver' to version '85.0.0' (#1312)
3afcc757a4 - Auto-update for packages related to 'healthcare-components-1.0.0-master-20201102-1' (#1427)
- Updates package 'Microsoft.Health.Abstractions' to version '1.0.0-master-20201102-1'
- Updates package 'Microsoft.Health.Api' to version '1.0.0-master-20201102-1'
- Updates package 'Microsoft.Health.Extensions.DependencyInjection' to version '1.0.0-master-20201102-1'
- Updates package 'Microsoft.Health.Core' to version '1.0.0-master-20201102-1'
- Updates package 'Microsoft.Health.Extensions.BuildTimeCodeGenerator' to version '1.0.0-master-20201102-1'
- Updates package 'Microsoft.Health.SqlServer' to version '1.0.0-master-20201102-1'
- Updates package 'Microsoft.Health.SqlServer.Api' to version '1.0.0-master-20201102-1'
- Updates package 'Microsoft.Health.Test.Utilities' to version '1.0.0-master-20201102-1'
- Updates package 'Microsoft.Health.Client' to version '1.0.0-master-20201102-1'
5d8f5d601d - Updates package 'Microsoft.SqlServer.SqlManagementObjects' to version '161.44091.28' (#1441)
e596566d83 - Updates package 'IdentityServer4' to version '4.1.0' (#1327)
4c7c173ae3 - Updates package 'Microsoft.Extensions.Configuration.AzureKeyVault' to version '3.1.10' (#1438)