Changes

Summary

1. speed up validation of message path (details)
2. Do not publish SubjectDeletedAnnouncement for updated subjects. (details)
3. #1135 implement basic tracing (using w3c trace context and kamon-opentelemetry), add dependency to kamon-opentelemetry, extend existing DittoMetrics timer to also create a trace, add rudimentary tracing (at least one trace per service) and read/propagate trace context at the edges (gateway/connectivity) (details)
4. #1135 document tracing configuration (details)
5. Add feature toggle for when-deleted subject announcements. (details)
6. fix bug in message path validation and add tests (details)
7. Resolve connectivity status from given exception for all client actors (details)
8. Remove TimeMeasuringFlow. (details)
9. added new MDC key "ditto-log-tag" used in Connection live status logs + switched misconfiguration to "warning" level (details)
10. #1135 make activiation of tracing configurable (generation of trace spans/context propagation) (details)
11. added "connection-id" MDC entry which got lost otherwise (details)
12. #1135 move tracing out of the metrics timer and provide a DittoTracing.wrapTimer instead (details)
13. review: made ImmutableConnectionFailurand ImmutableClientDisconnected package private, pulled static creators to interfaces (details)
14. review: added ConnectivityStatusResolver to BaseConsumerActor in order to resolve status in KafkaConsumer (details)
15. Switch to info level for misconfigured connectivity status (details)
16. Set connection status on every failure backoff based on the ConnectionFailure (details)
17. #1135 fix default channel in tracing config, add unit tests for context extraction/propagation (details)
18. handle 'canConnectViaSocket' for reconnect (details)
19. #1135 enclose tests for disabled tracing (details)
20. Treat kafka authenticaiton exceptions as user inidcated errors (details)
21. fixed duplicated throwable.getMessage() "statusDetails" error discription for JMS/AMQP1.0 errors (details)
22. added MQTT exceptions to "user-indicated-errors" (details)
23. added "connection-type" MDC for live-status log statements (details)
24. Allow to enhance the coded config list by specifying environment variables (details)
25. Fix hard-coded headers for HTTP protocol check. (details)
26. Configure exceptions for RabbitMQ that should be treated as user failure (details)
27. treat javax.net.ssl.SSLException as user failure (details)
28. review: added unit test in UserIndicatedErrorsTest testing the environment variable parsing of string objects (details)
29. additionally added configuration overwrites via system properties to make unit test run on Jenkins and via maven as well (details)
30. added timeout behavior to RetrieveConnectionStatusAggregatorActor: (details)
31. added timeouts multiple times if > 1 timeout was encountered; niceified code (details)
32. Categorize ssh tunnel exceptions (details)
33. tracing review: (details)
34. Add OpenAPI documentation about status 424 in messages routes. (details)
35. Add 424 responses to all requests that can request acknowledgements. (details)
36. update docker base image version to newest openj9 version; (details)
37. initial documentation of conditional updates; (details)
38. extend javadoc with ParserException; (details)
39. [#559] add conditionParam.yml and add reference in all thing resources; (details)
40. use ThreadSafeDittoLoggingAdapter in ThingsAggregatorActor; (details)
41. remove dependency to ditto-base-model in ditto-rql-model because it is not used; (details)
42. [#559] add condition header to DittoHeaderDefinition; (details)
43. [#559] fix ImmutableDittoHeadersTest; (details)
44. Test that subjects containing slashes cannot be deserialized as Adaptable. (details)
45. Fix parsing of slashes in topic or path of Ditto protocol messages. (details)
46. Handle topic path starting with "/". (details)
47. [#559] condition can be specified as query parameter and http header; (details)
48. [#559] extend unit test QueryParametersToHeadersMapTest; (details)
49. Reintroduce message path prefix validation for policy and thing message signals. (details)
50. Fix missing "extra" field in DittoProtocolAdapter#fromAdaptable. (details)
51. Add option to delete search entries immediately. (details)
52. Improve resilience of authentication chain. (details)
53. Do not log a stream completion exception as failed message consumption (details)
54. reflect consumer failure in connection status (details)
55. make fileNamePattern configurable via env variable; (details)
56. Add common certificate exceptions (details)
57. Add at least one cause for a failed source to the ConnectionFailedException (details)
58. Add missing mqtt exceptions (details)
59. Improve resilience of DittoRuntimeExceptionToErrorResponseFunction. (details)
60. Add log to analyze reasons of JMS errors (details)
61. Invalid destinations are a user failure (details)
62. [#559] implement conditional requests based on the condition in the ditto headers; (details)
63. Minor code changes during review (details)
64. [#559] fix broken test in ImmutableDittoHeadersTest; (details)
65. [#559] rework implementation of condition checking; (details)
66. [#559] add ThingConditionValidator; (details)
67. Fix enforcement timers not being stopped when filtered in pre-enforcer. (details)
68. Upgrade Akka libraries. (details)
69. Extend signal enrichment facade for search update; fix interpretation of delete events. (details)
70. Use CachingSignalEnrichmentFacade for search index update. (details)
71. Replace unnecessary SudoRetrieveThingResponse in EnforcementFlow; fix ThingUpdaterTest. (details)
72. use same version property for all kamon dependencies (details)
73. add OnStopHandler again as functional interface (details)
74. add tracing for enforcement (timer was removed from AbstractEnforcerActor on master) (details)
75. Enhance piggyback command responses with service and instance info. (details)
76. [#559] remove Condition class because no central validation of the specified condition is possible; (details)
77. [#559] introduce new FieldNamesPredicateVisitor to be able to extract the fieldNames from RQL expression; (details)
78. [#559] check read permission on all resource keys specified in the condition; (details)
79. fix "java.net.ConnectException" entry which contained the message in the exception name instead of the pattern (details)
80. Adjust documentation for piggyback command response format. (details)
81. update akka, scala, slf4j minor dependency versions (details)
82. added info logging for HTTP status code of http-push publishes (details)
83. improved failure logging, only log message on debug level (details)
84. pin used guava version to the one used in kamon-opentelemetry (details)
85. resolve deprecated API usage in HttpPublisherErrorTest (details)
86. Disable Java serialization. (details)
87. minor reformatting and improvements; (details)
88. [#559] add new exception ThingConditionInvalidException and unit test; (details)
89. Implement at-least-once message consumption for kafka (details)
90. [#559] add Ditto blog post for new conditional requests feature; (details)
91. Remove inheritance from Serializable interface. (details)
92. remove unused class (details)
93. add self reference to TaggedMetricInstrument (details)
94. add unit tests for tagging of PreparedTrace and StartedTrace (details)
95. extract adding tags from TaggedMetricInstrument interface, because some implementation might only be able to add tags not retrieve them. use TaggableMetricsInstrument for StartedTrace. (details)
96. add assertion to StartedKamonTraceTest and logback dependency for tests to suppress warnings (details)
97. remove debug logs in stream which were used during development (details)
98. Remove MessageSequentializer as it's not needed (details)
99. Configure parallelism in waiting for commit to max-in-flight (details)
100. explicitly add akka-http as dependency to connectivity-service (details)
101. review: harmonized AMQP 1.0 configuration for consumers/publisher with the Kafka one (details)
102. made DefaultConnectionConfig public again (details)
103. review: (details)
104. fixed unit test (details)
105. update caffeine dependency and fix compile errors (details)
106. Extract real cause out of potential CompletionException (details)
107. Cancel periodic priority update on delete connection (details)
108. Recover before MergeHub to avoid error log (details)
109. replace static scala version in dependency (details)
110. review findings: (details)
111. Add persistence methods to read SN from events and snapshots and delete them. (details)
112. add documentation for Kafka qos 0/1 (details)
113. fixed that connection status of misconfigured connections was changed to "failed" (details)
114. fixed RetrieveConnectionStatusResponse "missingResources" addition to resources arrays (details)
115. fixed ConnectionPersistenceActorTest#recoverOpenConnection (details)
116. empty status arrays shall not be added to resulting Json document at all (details)
117. fixed RetrieveConnectionStatusResponseTest (details)
118. To avoid a timeout in RetrieveConnectionStatusAggregatorActor (details)
119. There is only one publisher actor for all targets (details)
120. Decrease akka-management.version back to 1.0.10 because of (details)
121. Add credit stream for background cleanup. (details)
122. Restructured AtLeastOnceConsumerStream (details)
123. Add PersistenceCleanUpActor. (details)
124. - set target resource status of dynamic targets (target address with placeholders) to UNKNOWN as we do not track those states (details)
125. Make KafkaConsumerStream @Immutable (details)
126. Await stopping of KafkaConsumerStream to a maximum of 10 seconds (details)
127. Instead of restarting the whole KafkaConsumerActor just restart the (details)
128. Rename and test CleanUpConfig; add PersistenceCleanUpActor.props (details)
129. Restart KafkaConsumerStream with exponential backoff (details)
130. backoff after a consumer was closed before recreating the message consumer to better reflect the actual state of the consumer in the source resourse status (details)
131. Count successful and failed acknowledgements in connection metrics (details)
132. add unit test for AmqpConsumerActor backoff and resource status update (details)
133. Avoid couting rejected messages as consume failures (details)
134. Fix and add unit tests (details)
135. Start PersistenceCleanUpActor in Things, Policies, Connectivity. (details)
136. Add counters for events and snapshots deleted in the background. (details)
137. Make deleted snapshots empty. (details)
138. Remove centralized background cleanup. (details)
139. Add live config retrieval and modification for background clean-up. (details)
140. add GH discussions as another feedback channel (details)
141. Reduce code duplication (details)
142. stabilize failure detection of connectivity live status (details)
143. fixed Ditto tracing precision bug regarding use of Instant.now(), use Kamon's clock instead (details)
144. round of HTTP parallelism to next factor of two (details)
145. use .map(DefaultHttpPushFactory::determineNextPowerOfTwo) in DefaultHttpPushFactory (details)
146. Make PoliciesRoute Path public (details)
147. Add SearchUpdateListener to MongoSearchUpdaterFlow (details)
148. Organized some imports and sorted Ditto modules alphabetically. (details)
149. Fixed config for things-search update listener implementation value. (details)
150. Fixed `SearchActorIT`. (details)
151. Use SearchUpdater in mapping stage instead of sink (details)
152. Issue #1093: Introduced `EntityIdInvalidException`. (details)
153. Issue #1093: Made `NamespacedEntityIdInvalidExcaption` a subclass of `EntityIdInvalidException`. (details)
154. Issue #1093: Small improvements. (details)
155. Increased some test time-outs which failed because of actorSystem init (details)
156. Add JsonParsable und fromJson to EntityIdForTestsInvalidException for error registry tests (details)
157. test UserIndicatedErrors matching with "cause" being the matching class (details)
158. Fix rebase (details)
159. PersistenceCleanUpActor: Enable setting last-pid in ModifyConfig (details)
160. fixed determination of cluster connectivity instances count (details)
161. review: renamed consumerRestartBackOffConfig to restartBackOffConfig (details)
162. Document new background cleanup DevOps API. (details)
163. Fix some code-smells (details)
164. Fix DefaultPersistenceStreamingActorTest. (details)
165. Log non successful status codes as failure for http publishes (details)
166. review: don't assume ConnectivityStatus.FAILED in AmqpPublisherActor when producer is closed (details)
167. fixed mocking in AmqpPublisherActorTest (details)
168. fix AmqpConsumerActorTest (details)
169. fix BaseClientActor backoff behavior: increase state timeout only for the first failure received during backoff (details)
170. enhance the message rejected log with information to identify the message that was rejected (details)
171. added more detailed resource "statusDetails" message for AMQP 1.0 producer closed (details)
172. also test the case when backoff is triggered from CONNECTED state (details)
173. Do not filter null record values (details)
174. Handle expired messages after transformation to ensure they are (details)
175. Document message expiration behavior for kafka (details)
176. fix spelling (details)
177. review: add "failureCount" to backoff/reconnecting logging (details)
178. remove 503 error response for messages from openapi docs (details)
179. review: rename CleanUp, add unit tests for CleanupResult and SnapshotRevision (details)
180. stabilize AmqpConsumerActorTest (details)
181. add JS mapper configuration to allow use of "unsafe" standard objects (useful when debugging) (details)
182. review: rename CleanUp (details)
183. Add visitors to compute the diff of BSON documents. (details)
184. Test incremental update via BsonDiff. (details)
185. Use BsonDocument as the document type for search index update. (details)
186. Introduce incremental update into search updater stream. (details)
187. Add 1% force update probability to ThingUpdater. (details)
188. Add counters for search background sync stream. (details)
189. Search updater: Add shortcut for identical JSON object diff. (details)
190. Fix incremental search update. (details)
191. Search update: improve array diff computation; optimize diff of internal arrays. (details)
192. Fix filter of UpdateOne write model; fix nonnegative hashcode computation. (details)
193. Fix code smells; remove unnecessary cleanup config in Concierge. (details)
194. Fix unit tests. (details)
195. [#1170]: Implement fn:replace (details)
196. #898: restructured DittoProtocolAdapter to be able to determine the TopicPath for a given Signal (details)
197. #898: moved ditto-internal-models-placeholders to a public module "ditto-placeholders" (details)
198. Enrich deleted events with last state of twin if signal enrichment is (details)
199. respond with overall live connectionStatus "open" when subresources are in "unknown" state but all clients are "open" (details)
200. update to Netty 4.1.68.Final (details)
201. improve logs in order to find out why some amqp 1.0 connections still "fail" (details)
202. Ensure ConnectionLoggerRegistry and DefaultMuteableConnectionLogger do not throw exceptions (details)
203. update logback to 1.2.6 (details)
204. Add missing periods (details)
205. #898: made "ditto-placeholders" a valid OSGi module (details)
206. prolonged RedHat's copyright year to 2021 (details)
207. #898: fixed Java 11 usage when ditto-placeholders now must be Java 8 compatible (details)
208. Remove MongoDB dependencies from Concierge. (details)
209. Split implementation of CacheKey for SignalEnrichment and Enforcement (details)
210. #898: fixed broken search for top-level thing "definition" (details)
211. Search updater: fix timer timeout and update error due to empty objects. (details)
212. Search updater: support nested {} as value. (details)
213. Fix double slashes in location header (details)
214. #898: enhanced SignalFilterTest unit test by testing with "topic:action" for modified events and "topic:subject" for filtering live messages (details)
215. Increase default outbound message queue size to 1000 (details)
216. Introduce source queue for MqttPublisherActors (details)
217. verify successful AmqpConsumerActor startup by checking their resource status after starting them (details)
218. review for deleted event enrichment: (details)
219. Fix IllegalArgumentException due to empty updates. (details)
220. fix NPE in unit test and verify resource status is correct after consumer actor failure (details)
221. A correlation ID shout not be part of the cache key (details)
222. Add correlation ID to headers if not present (details)
223. RetrieveThing and SudoRetrieveThing cannot be applied when thing is null (details)
224. allow overwriting the Contextual.askWithRetryConfig (details)
225. Use UnaryOperator instead of function (details)
226. Issue #106: Fixed formatting of `DittoHeaderDefinition`. (details)
227. review: adjusted config environment keys to include "AMQP10_" prefix (details)
228. Issue #106: Added validator for ditto channel header. (details)
229. Issue #106: Made ditto channel header readable from external headers. (details)
230. Issue #106: Removed 'ditto' prefix of channel header key as it is now externally settable. (details)
231. UriForLocationHeaderSupplier: Test trailing slash. (details)
232. reset session data after failure in base client actor (details)
233. allow to use an URL as "definition" for Thing + Feature definitions in addition to the namespace:name:version (details)
234. Fix updater errors due to string values starting with '$'. (details)
235. NamespacedEntityIds cannot identify a connection (details)
236. Extract inner class to super class as cohesion is very low (details)
237. increase Mockito.verify() timeout of MockSnapshotStorePlugin to 10s to stabilize CI (details)
238. Apply e2e backpressure by using requested acks (details)
239. Review commit: (details)
240. [#559] - review blog post (details)
241. [#559] - review openapi (details)
242. add "conditional updates" and move "signal enrichment" to "signal types" sub-folder (details)
243. review conditional updates (details)
244. [#559] Add more unit tests to new 'condition' validator (details)
245. [#559] Add unit tests for new field name visitor and little refactoring (details)
246. Issue #559: Renamed local variable to plural. (details)
247. Issue #559: Removed duplicate empty line and throw an AssertionError in constructor of this utility class. (details)
248. [#559] Make ditto headers mandatory for condition failed exception (details)
249. #559 extend QueryParametersToHeadersMapTest and test setting AllowPolicyLockout header via query parameters; (details)
250. #559 extend docu and blog post; (details)
251. remove http request directive from code snippet; (details)
252. #559 include docu review findings; (details)
253. #559 remove condition from message in ThingConditionFailedException; (details)
254. #559 add condition to protocol-envelope.json and protocol-specification.md; (details)
255. #559 extend ExistsFieldExpressionVisitor and FilterFieldExpressionVisitor to use metadata in conditions; (details)
256. #559 remove implementation for visitMetadata in GetExistsBsonVisitor and GetFilterBsonVisitor; (details)
257. #559 return bson filter that don't match for visitMetadata because searching for metadata isn't supported; (details)
258. #559 update date of blog post; (details)
259. remove unused imports; (details)
260. #559 update blog post; (details)
261. #559 use UTC timestamps in blog post example; (details)
262. add 'channel' option to http query parameters; (details)
263. removed ditto prefix from channel variable in DittoChannelValueValidator; (details)
264. add optional MetricsAlert to SlidingWindowCounter that triggers a given action in case a given condition is met, implement ThrottledMetricsAlert that detect if a metric has reached a given threshold, use the ThrottledMetricsAlert to monitor the consumed inbound counters and record threshold exceedance in the new THROTTLED metrics counter, fix DefaultConnectionThrottling config loading the corrct values from the given config (details)
265. add throttling detection tolerance to configuration, some javadoc and cleanup (details)
266. use last timestamp to determine the value of throttled metric for 1min measurement window (allowes more accuracy) (details)
267. Remove "deleteAt" from search queries to work around MongoDB issue SERVER-12869. (details)
268. Add documentation for backpressure of kafka consumers based on requested-acks (details)
269. added empty lines around code block (details)
270. added release notes for Ditto 2.1.0 (details)
271. update Kafka client to 2.8.1 (details)
272. enhanced Ditto 2.1.0 release notes to final state (details)
273. added Ditto 2.1.0 announcement blogpost (details)
274. update supported versions security-wise (details)
275. make readConcern and readPreference to use for MongoThingsSearchUpdaterPersistence configurable (details)
276. configured "binary-compatibility-check.version" version to 2.1.0 (details)
277. added Ditto logo / artwork (details)
278. adjusted @since javadoc to 2.2.0 (details)
279. handle modifications to throttling config for kafka sources by adapting the costs per message dependent on the configured limit per interval (details)
280. adapt enforcement of live events and responses; (details)
281. update throttling alerts on modification of throttling config (details)
282. fixed drop behavior of mapping queue in LegacyBaseConsumerActor (details)
283. use classloader of EntityId to find annotated classes (details)
284. adjust review comments; (details)
285. change permission check to have unrestricted permission for live events; (details)
286. Revert "use classloader of EntityId to find annotated classes" (details)
287. provide blog post with overview of new kafka consumer feature (details)
288. Adjust date of blog post (details)
289. Kafka blogpost review: applied some formatting, fixes of dead links (details)
290. added topnav_title to blogposts (details)
291. add method to get a list of unrestricted authorization subjects to enforcers and use it in concierge to calculate read-subjects (details)
292. remove setLiveChannelName method from RootRouteHeadersStepBuilder; (details)
293. fixed that in Thing3ValudePredicateVisitor the "isUnknownField" did not categorize "extra" fields being in "unknownFields" starting with the actual fieldExpression to check, e.g. "/attributes" might be enriched, then "/attributes/foo" must be categorized as "unknown" field and be not filtered prior to enrichment (details)
294. added new ResourcePlaceholder providing "resource:type" and "resource:path" (details)
295. route liveQueryCommandResponses from StreamingSessionActor and OutboundDispatchingActor to concierge for filtering the response based on the policy; (details)
296. Issue #559: Throw `ThingNotCreatableException` for POST on things base route with live channel. (details)
297. use more common max-queue-size as config key for outbound mqtt queue size (details)
298. set next ditto version for @since (details)
299. #898: added documentation for filtering events+messages using RQL property "topic:" and "resource:" (details)
300. Fix that subject deletion announcement was not published when 2 subjects of the same ID were deleted. (details)
301. Fix timing issue in PolicyAnnouncementManagerTest. (details)
302. improved DittoPublicKeyProvider exception handling + logging on cache loading the JWT public key (details)
303. Minor review changes (details)
304. minor improvements and code formatting; (details)
305. #898: don't format placeholders for RQL expressions in documentation with "{{ }}", but plain (details)
306. fixed license header year (details)
307. add channel parameter to ditto swagger docu; (details)
308. add documentation about live channel to http docu; (details)
309. add blog post for new http live channel; (details)
310. send out channel header in responses; (details)
311. add tag ditto_channel to round trip timer; (details)
312. route liveQueryCommandResponses from StreamingSessionActor and OutboundDispatchingActor to concierge for filtering the response based on the policy; (details)
313. Add first implementation for http-push live command response handling (details)
314. Add first test for live command response handling of http-push (details)
315. remove @Nullable annotation from proxyActor ref; (details)
316. small improvements to ditto documentation (details)
317. Remove ConnectionContext (details)
318. extend headers in MessageCommandAdapterTest and HeaderTranslatorTest with channel header which is now send out to the requester; (details)
319. Stop the kafka consumer actor after stopping the consumer stream (details)
320. Remove unused DittoHeaders from ConnectionConfigProvider (details)
321. fix javadoc (details)
322. increase size of ack labels according to size increase of connection IDs (details)
323. add method addEffectedReadSubjectsToThingLiveSignal to LiveSignalEnforcement to restore previous behavior of read subject determination; (details)
324. Issue #559: Validate channel header immediately on setting in `DittoHeadersBuilder`. (details)
325. make ProtocolMessageType public so it can be used in other packages; (details)
326. add docu review comments; (details)
327. add review comments to new blog post; (details)
328. add review comments to swagger docu; (details)
329. stabilize connection live status for amqp 1.0 connections (details)
330. - Do not block in preStart method of ConnectionSupervisorActor. Instead use message to signal when initialization (retrieval of config) is done. (details)
331. Issue #559: Fixed static factory method of `RetrieveFeatureDesiredPropertiesResponse`. (details)
332. Fix status 500 when sorting a field containing non-primitive values. (details)
333. enable loading additional extra JavaScript libraries which can be used in Ditto's JS based payload mapping (details)
334. Issue #559: Made `Acknowledgement#TYPE` constant public as access is required from another package. (details)
335. fix toString() of Whoami + debug loggin in AbstractHttpRequestActor (details)
336. Issue #559: Added `CorrelationId` and `TestNameCorrelationId` test utilities to make them available for Ditto unit tests. (details)
337. Review: Delay AMQP consumer status retrieval. (details)
338. Issue #559: Added validation for types of live command responses, i.e. the response has to be associated with the beforehand sent command. (details)
339. Issue #559: Removed instance field for proxy actor from `OutboundDispatchingActor`. The proxy actor can be derived from `OutboundMappingSettings`. (details)
340. Issue #559: Fixed `HeaderTranslatorTest` as channel now is not internal only anymore. (details)
341. Issue #559: Refactored `StreamingSessionActorTest` to make use of `ActorSystemResource`. (details)
342. Issue #559: Fixed unexpected text in Javadoc. (details)
343. Issue #559: Fixed wrong expectation in `HttpPublisherActorTest`. (details)
344. Issue #559: Make sure that reflection based test data generation does not silently omit implementations. (details)
345. Bring back mergeHub (details)
346. use regex pattern to determine messages requests; (details)
347. Issue #559: Fixed compilation error. (details)
348. Refactor AtMostOnceConsumerStream to not materialize 1 external message sink per message. (details)
349. adapt regex pattern to determine message path queries; (details)
350. Fix AtMostOnceConsumerStreamTest and adapt AtLeastOnceConsumerStream (details)
351. Remove recoverWithRetries steps because they were only needed for MergeHub (details)
352. Revert changes in kafka consumer streams back to use flatMapConcat (details)
353. Issue #559: Minor refactoring. Mainly code formatting, simplified some methods. (details)
354. extend BasePublisherActor with reference to proxyActor to be able to send commands to concierge; (details)
355. fix missing variable; (details)
356. Issue #559 minor simplifications (details)
357. Polished the Ditto project landingpage (details)
358. fixed test in HttpPublisherActorTest; (details)
359. refactor duplicate message template; (details)
360. small code improvement; (details)
361. fixed formatting of JSON examples (details)
362. Issue #559 remove workaround and build response corrently (details)
363. minor code improvement; (details)
364. Issue #559: Moved test utils to more appropriate modules/packages. (details)
365. explicitly configure MongoDB query batchSize same as the limit (details)
366. Count only successfully mapped outcomes into throttling (details)
367. Issue #559: Added "correlationid" package to test-jar. (details)
368. Issue #559: Include all test packages in test-jar. (details)
369. added slides for EclipseCon 2021 IoT community day (details)
370. fixed a bug where an additional source status is shown when a mqtt source has two or more addresses; (details)
371. Fix timeout of acknowledgement aggregator (details)
372. simplify construction of sinks in kafka consumer streams (details)
373. Issue #559: Introduced new internal module for `Signal` related functionality. (details)
374. publish connection logs via fluency library to fluentd/fluentbit (details)
375. align sourceStatus presentation for status "unknown/failure/misconfiguration" with status open for mqtt connection; (details)
376. add prefab values to testEqualsAndHashcode for ConnectionLoggerRegistryTest and DefaultConnectionMonitorRegistryTest; (details)
377. Throttle kafka consumer stream also after consuming a record from Kafka (throttling after payload mapping has already been implemented). This early throttling avoids being overloaded with malformed messages and processing them at full speed. (details)
378. add java doc to newPublishingLogger; (details)
379. Issue #559: Fixed Javadoc error. (details)
380. Issue #559: Fixed compilation error and test errors. (details)
381. Refactor CachingSignalEnrichmentFacade (details)
382. Load CachingSignalEnrichmentFacade via Akka Extension (details)
383. Remove unnecessary javadoc from DittoCachingSignalEnrichmentFacade (details)
384. Add caching signal enrichment provider to configs (details)
385. Allow background sync stream to determine whether to invalidate cached things or policies. (details)
386. Add actorSystem to SignalEnrichmentProvider (details)
387. Fix unit tests. (details)
388. Optimize ThingEvent/ Signal casting in DittoCachingSignalEnrichmentFacade (details)
389. Extract search MongoDB clients in an extension; extend ShutdownBehavior to accept namespaces. (details)
390. Fix javadoc. (details)
391. Seperate shard region and proxy creation methods in ShardRegionFactory; add entity ID parameter to ShutdownBehaviuor. (details)
392. Little change (details)
393. Resolve merge conflicts (details)
394. Make review changes (details)
395. Reduce code duplication; remove completed TODO. (details)
396. Enable aknowledgement handling for UpdateThing. (details)
397. Add min-acceptable-seq-number to retrievePartialThing. (details)
398. Add field selectors to SudoSignalEnrichmentFacade. (details)
399. Handle empty updates. (details)
400. Fix toString for AbstractWriteModel implementations (details)
401. Minor review changes (details)
402. Make SearchUpdateMapper asynchronous. (details)
403. Add possibility to send weak acks to metadata (details)
404. Rename sendWack to sendWeakAck (details)
405. Search update: send weak acknowledgements for empty diffs. (details)
406. Search updater: move incremental update computation to SearchUpdateMapper. (details)
407. BsonDiff: extract SET annd UNSET operators as static constants. (details)
408. Extract and document "toIncrementalMongo" methods. (details)
409. Remove empty update test in BsonDiffVisitorIT. (details)
410. BackgroundSyncActor: request ack to discover failed and skipped updates. (details)
411. ThingUpdater: make incremental updates also work for background sync. (details)
412. Fix invalid empty list result in DittoCachingSignalEnrichmentFacade; remove some redundant warning logs (details)
413. Minor review changes (details)
414. Add debug log of all executed write models in MongoSearchUpdaterFlow. (details)
415. Reduce the log level for empty updates from WARN to DEBUG. (details)
416. Unify search updater stream to maintain diff consistency. (details)
417. Recover last write model when starting a ThingUpdater. (details)
418. Set default force update probability to 0. (details)
419. Issue #559: Fixed another test error. (details)
420. Fix rebasing (details)
421. added configuration classes for configuring all settings of Fluency library (details)
422. fixed wrong date in presentations.md (details)
423. Adjust license header (details)
424. add library default for some fluency variables to connectivity.conf; (details)
425. Issue #559: Moved TestNameCorrelationId to ditto-base-model to avoid circular dependencies. (details)
426. Issue #559: Moved `SignalInformationPoint` to module "ditto-internal-models-signal" to make is usable in a broader scope. (details)
427. Issue #559: Fixed toString implementation. (details)
428. Issue #559: Allow setting of custom HTTP status to `UnsupportedSignalException`. (details)
429. Issue #559: A response Signal with an invalid type leads to HTTP status 500 as this should never happen. (details)
430. inject custom "log-tag" + "additional-log-context" to published logs via Ditto configuration (details)
431. fixed equals/hashCode of ConnectionLoggerRegistry (details)
432. allow method DELETE in HTTP push targets (details)
433. make logLevels to publish configurable via Ditto config (details)
434. Add ClientCredentialsFlow for HTTP connections and test happy paths. (details)
435. Fix ConnectivityServiceGlobalErrorRegistryTest. (details)
436. Add ClientCredentialsFlow for HTTP connections. Make JwtInvalidException a user-indicated error. (details)
437. Issue #559: Validate live command responses in `AbstractHttpRequestActor`. (details)
438. add oauth client credentials to connectivity model (details)
439. Issue #559: Minor refactoring. (details)
440. Switch to request-level API for token acquisition in HTTP connections. (details)
441. added releasenotes for Ditto 2.1.1 (details)
442. improve naming of OauthClientCredentials members, add validation for requested scopes (details)
443. Augment requests with OAuth2 tokens; add togglable validation that the token endpoint protocol is HTTPS. (details)
444. cache jwt validator (details)
445. Issue #559: Introduced factory for creating shard region proxy actors. (details)
446. Use pinned dispatcher for kafka consumer in order to have one thread (details)
447. Tell kafka broker to wait up to 10 seconds before answering (details)
448. keep order of json elements in connection model in set structures (details)
449. flush logs of FluentPublishingConnectionLogger by (details)
450. Issue #559: Extended `SignalInformationPoint`. (details)
451. Issue #559: Added `AddConnectionLogEntry`. (details)
452. Issue #559: Reworked constructor of `AbstractRoute` and changed response validation failure handling in `AbstractHttpRequestActor`. (details)
453. minor cleanup after JWT caching PR (details)
454. try to stabilize HttpPublisherErrorTest (details)
455. stabilize flaky MQTT tests by using random correlationIds in AbstractMqttClientActorTest#testConsumeMultipleSources() (details)
456. ignore failing HttpPublisherErrorTest (details)
457. Review: code formatting (details)
458. fix compile error; (details)
459. fix caching of removed thing fields when modifying a complete thing, e.g. removing an existing definition (details)
460. Issue #106 add auth context of target to sending-context (details)
461. Issue #106 Enforce requesters auth context for live retrieve commands (details)
462. Issue #106 Adapt unit-test, to make sure that the right auth-ctx is used. (details)
463. fixed adding missing "_created" field for ThingCreated events (details)
464. updated to Akka HTTP 10.2.7 due to critical reported CVE (details)
465. undid special ThingDeleted handling again as not required for bugfix (details)
466. Fix ConnnectionValidatorTest. (details)
467. remove json array merging functionality from JsonObjectMerger; (details)
468. make waitUntilAllBufferFlushedDurationOnClose configurable (details)
469. reduce warn log to info for messages received during startup of persistenceactors (details)
470. Review: ensure duration is non-negative and not zero when reading the config value; (details)
471. Review: Fix license header; stabilize unit tests. (details)
472. allow to skip waiting for buffer flushing when waitUntilAllBufferFlushed is 0 or negative; (details)
473. ignore failing test temporarily (details)
474. ignore failing test temporarily, this time the right test (details)
475. Add KafkaConsumerMetricRegistry for collecting kafka consumer metrics (details)
476. Document OAuth2 client credentials flow for HTTP connections. (details)
477. added documentation for "connection log publishing" feature (details)
478. stabilized AmqpClientActorTest.testSetMessageListenerOnConsumerFails (details)
479. omit request body for GET and DELETE requests made via http push connection, add configuration option and allow override via specific config (details)
480. Fix DefaultHttpPushConfigTest. (details)
481. review: remove redundant values from connection json to improve readability (details)
482. fixed typos in docu; (details)
483. added @Nullable annotation to SignalEnrichmentFacade.retrievePartialThing for JsonFieldSelector (details)
484. Add Kamon orchestration for Kafka consumer metrics. (details)
485. apply host validation to configured token oauth token endpoint (details)
486. Issue #106 extend protocol adapter (details)
487. Issue #106 fix unit test (details)
488. Add LazyZip to ensure HTTP connections request token at the time of signal publication. (details)
489. Adjust kafka consumer metric naming (details)
490. Fix LazyZipTest. (details)
491. Fix concurrency issues in KafkaConsumerMetricsRegistry (details)
492. Correct dependency mgmt. for kamon akka (details)
493. Fix diff computation on nested arrays. (details)
494. don't add "<not-provided>" correlation-id to published logs (details)
495. don't add "<not-provided>" correlation-id to published logs, fixed also for debug log (details)
496. Rework after merge (details)
497. improve connection log texts, e.g. remove dots at the end (details)
498. fixed SendingTest (details)
499. modified default success/failure/exception message to include the log type in order to e.g. not have "Message processed" message for each log type (details)
500. Test OAuth endpoint when testing an HTTP connection. (details)
501. Fix assertion in HttpPublisherActorTest#testOmitRequestBody. (details)
502. Issue #1228 add ditto header for new 'liveChannelCondition' header (details)
503. Reduce defaut fetch.max.wait.ms for kafka consumers to 5 seconds (details)
504. Issue #106: Use only simple class name for correlation ID. (details)
505. Issue #106: Moved 'AddConnectionLogEntry' from module 'model' to more appropriate module 'api'. (details)
506. Issue #106: Added method to directly log 'LogEntry' to 'ConnectionLogger'. (details)
507. Issue #106: Let 'ConnectionPersistenceActor' handle 'AddConnectionLogEntry'. (details)
508. Issue #106: Added method to get optional correlation ID from a specified Signal. (details)
509. Issue #106: Refactored 'AcknowledgementAggregatorActor'. (details)
510. Remove unused dependency (details)
511. Review changes (details)
512. Use consumerId also for deregistering from kafka consumer metrics (details)
513. De-Register automatically after the consumerControl has completed either successfully or execptionally (details)
514. Move KafkaConsumerMetricsRegistry registering to extra method (details)
515. enforce connectionId type for parameters (details)
516. Issue #106: Reworked handling of matching validation result failure. (details)
517. Issue #106: Harmonized behaviour of 'HttpPushRoundTripSignalsValidator' with 'AbstractHttpRequestActor'. (details)
518. Remove ConsumerMetricsRegistry and schedule reporting in consumer actor instead (details)
519. Enforce stronger type for source suppliers in consumer streams (details)
520. remove unnecessary blank lines (details)
521. Remove unnecessary config (details)
522. Enforce stronger type for sinks in ConsumerStream constructors (details)
523. Issue #106: Added method to stop actor to 'ActorSystemResource'. (details)
524. Issue #106: Fixed compilation error in 'AcknowledgmentAggregatorActorTest'. (details)
525. added Ditto 2.1.2 release notes (details)
526. Issue #106: Removed unused code and fixed some code smells. (details)
527. Issue #106: Removed unused code and fixed some code smells. (details)
528. added documentation about the available fields for the "connectivity log publishing" feature (details)
529. Issue #106: Fixed some code smells. (details)
530. Add header "twin-fallback-after" for smart channel selection. (details)
531. Try alternative message path for filtering live query response. (details)
532. use camelCase for tag names (details)
533. Restore authorization context for live response enforcement in Concierge. (details)
534. Issue #106: Added methods to 'SignalInformationPoint'. (details)
535. add `PATCH` verb to CorsEnablingDirective (details)
536. use latest protobufjs webjar for unit test; don't use minimized version (details)
537. Fix build for MacOS (details)
538. Concierge: Add an actor to handle live thing query commands with custom acknowledgement requests. (details)
539. Fix license header year. (details)
540. small code and javadoc adjustments; (details)
541. remove null check getCategory returns null in some cases; (details)
542. small code format improvements; (details)
543. Issue #106: Moved command-response-round-trip validation to 'AcknowledgementAggregationActor'. (details)
544. update date of blog post and extend blog post with special handling of command responses from devices; (details)
545. update http docu for special handling of live responses; (details)
546. [#1231]: Allow using the dash a part of the namespace (details)
547. [#1228] provided new "UpdateTwinWithLiveResponse" MessageMapper for creating "MergeThing" commands for updating the twin when a "live response" was consumed via a connection source (details)
548. removed unused method in SignalTypeFormatException; (details)
549. [#1231] adjusted documentation for namespace constraints by supporting the dash as well (details)
550. introduce new metrics alert on the inbound throttled metric that writes a log entry to the corresponding connection logger in case a source was throttled (details)
551. log headers and payload for mapped signals (details)
552. Issue #106: Deprecated field definitions for JSON schema version as it is not required by Ditto. (details)
553. Issue #106: (WIP) Keep response receivers for *live* signal enforcement until evicted by cache. (details)
554. add TODO for changing the since annotation; (details)
555. added namespace scoped loggers for logging details on ThingCommandEnforcement command forwarding (details)
556. Issue #106 minor fixes (details)
557. Allow to configure connection.max.idle.ms via environment variable (details)
558. added release notes and post-release steps for Ditto 2.2.0 release (details)
559. Issue #106: Introduced evicting cache for response receivers. (details)
560. Switch to ByteSerializer and ByteDeserializer for Kafka Consumer and Publisher (details)
561. Issue #106: Validate resource paths of live ThingCommand and its response. (details)
562. Issue #106: Fixed unit test. (details)
563. Use ByteBuffer(De)Serializer for kafka to better align with byte payload type of our ExternalMessage (details)
564. Issue #106: Do not validate resource path matching for error responses. (details)
565. Support different charsets for TextPayload (details)
566. add @Nullable annotation and extended some javadoc; (details)
567. Improvements after review (details)
568. review: worked on "http live channel" blog post; adjusted Ditto release version to 2.3.0 (details)
569. fixed wording in httpapi-overview.md docs about channel (details)
570. Review: Ensure dittoHeadersForMerge of UpdateTwinWithLiveResonseMessageMapper is non-null; add assertion that the channel header is not set after mapping. (details)
571. Issue #106: Extract 'channel=live' header also for Error responses (details)
572. Issue #106 add 'since' annotation (details)
573. Issue #106: review: add @since annotation, format code, remove unnecessary 'public' keyword (details)
574. [#106] review: fixed Ditto version 2.2.0 in "@deprecated" javadoc mentions, corrected to 2.3.0 (details)
575. Also disable hostname verification when connection wants to ignore SSL (details)
576. Also use kamon/prometheus metrics to monitor connection live status reports (details)
577. Issue #1228: change header values for live channel timeout fallback from duration to a strategy enum. (details)
578. [#1228] added DittoHeaderDefinition "live-channel-condition-matched" which will also be written to external headers to find out whether the live channel condition matched (details)
579. Issue #1228: apply policy enforcement to live-channel-condition in addition to condition header (details)
580. [#1228] review: fixed javadoc of EnumValueValidator + header definition; added unit test for EnumValueValidator; adjusted message and description of thrown exception if enum value is not known; (details)
581. introduce extendable ThingEventObserver to allow custom processing of thing events (details)
582. [#1228] Evaluate live-channel-condition-match in Things (details)
583. Classify more exceptions as unser indicated errors (details)
584. fix instantiation of DefaultThingEventObserver (details)
585. Fix outdated documentation (details)
586. fixed wrong java code snippet in conditional updates blogpost (details)
587. Also remove unnecessary cd in build with docker step (details)
588. fixed checkmark in table that filtering messages based on RQL is supported (details)
589. move custom processing of search updates to EnforcementFlow to allow usage of the available thing json data in the extension, add reason to search update metadata (e.g. if it was caused by thing update or background sync) (details)
590. minor documentation fixes concerning messages (details)
591. allow multiple search update reasons in metadata (details)
592. Issue #106: Reworked deserialization of CommandResponses from JSON. (details)
593. Issue #106: Formatted DittoHeaderDefinition to improve readability. (details)
594. Issue #106: Improved exception handling of JSON deserialization of UnsupportedSignalException. (details)
595. fix log statements which only mention delcared acks in ClusterMemberRemovedAware which is not only used for ACKs .. (details)
596. [#1228] Delay LiveResponseAndAcknowledgementForwarder termination until valid response is received. (details)
597. add new FieldType for fields with marked as special or hidden; (details)
598. [#1228] send query response back to concierge; use single ask for live commands (details)
599. [#1228] add initial implementation of smart channel selection. (details)
600. added documentation for executing policy- and thing-commands via piggyback commands (details)
601. [#1228] fix live response auth context and live error response forwarding. (details)
602. [#1228] added http headers "on-live-channel-timeout" and "live-channel-condition" to be able to also pass in via HTTP query params (details)
603. add @Nullable annotations to some variables and methods; (details)
604. extend UpdateThing with UpdateReason; (details)
605. remove streaming of thing events functionality because it isn't used anymore; (details)
606. Issue #106: Introduced an HTTP status validator. (details)
607. Issue #106: Introduced AdaptableToSignalMapper. (details)
608. Issue #106: Added static factory method for omitting HTTP status validation. (details)
609. Issue #106: Began to prepare command responses for safe mapping from Adaptable. (WIP) (details)
610. Issue #106: Added getters for optional thing and policy ID to MappingContext. (details)
611. Use fully qualified container images (details)
612. Allow pushing containers too (details)
613. [#1228] fix various issues in live channel condition evaluation (details)
614. Issue #106: Use HTTP_STATUS constant. (details)
615. Issue #106: Added getter for optional FeatureDefinition. (details)
616. Issue #106: Added getter for optional FeatureProperties. (details)
617. [#1228] Smart-channel-selection: Fix timeout exception headers; add message for live channel precondition failed exception (details)
618. [#1228] fix wrong .toString() call which caused "Optional[..]" to be part of the string (details)
619. Issue #106: Added getter for feature property pointer and value and removed some redundancy. (details)
620. Issue #106: Added getter for feature desired property pointer and fixed some bugs. (details)
621. re-enabled executing Junit4 tests in modules which have both Junit4 and -5 tests (details)
622. Adjust PolicyModifyCommandResponseMappingStrategies (details)
623. Issue #106: Adjusted thing modifying command responses and ThingModifyCommandResponseMappingStrategies for safe mapping from Adaptable. (details)
624. Fix api break (details)
625. Issue #106: Fixed Maven build. (details)
626. Issue #106: Added some policy-related test cases. (details)
627. Issue #106: Reduced some redundancy (WIP). (details)
628. fix some javadoc, unignore and adapt unit test to changed behavior (details)
629. add documentation on live channel condition (details)
630. cleanup some tests, javadoc and TODOs (details)
631. remove documentation of partial thing update with PUT (details)
632. [#1228] moved restoration from connectivity command headers from AcknowledgementAggregatorActor.restoreCommandConnectivityHeaders (details)
633. [#1228] re-added exclusion for binary comp check of ditto-placeholders (details)
634. Issue #106: Further removed redundancy. (details)
635. fixed UpdateReason in ThingsUpdaterTest; (details)
636. [#1228] fixed javadoc errors (details)
637. [#1228] undid adjusting CommandResponse.isOfExpectedResponseType to always be "true" for live responses (details)
638. added openapi documentation (details)
639. Issue #106: Adjusted thing query command responses and ThingQueryCommandResponseMappingStrategies for safe mapping from Adaptable. (details)
640. Issue #106: Adjusted RetrieveThingsCommandResponse and RetrieveThingsCommandResponseMappingStrategies for safe mapping from Adaptable. (details)
641. Issue #106: Adjusted MergeThingResponse and ThingMergeCommandResponseMappingStrategies for safe mapping from Adaptable. (details)
642. [#1228] Apply live channel fallback strategy to live commands. (details)
643. feat: Allow restricting the creation of resources (details)
644. Issue #106: Fixed ThingMergeCommandResponseMappingStrategies. (details)
645. [#1228] fixed classCastException in usage of CommandHeaderRestoration (details)
646. Issue #106: Validate HTTP status(es) directly in command response. (details)
647. Issue #106: Treat JSON null literal as if payload contains no feature. (details)
648. Issue #106: fix 'ConciergeServiceGlobalErrorRegistryTest' (details)
649. [#106] fixed things-service unit tests after merge from dev (details)
650. [#1228] Add SmartChannelSelectionTest. (details)
651. update logback to 1.2.8 (details)
652. [#1228] review: (details)
653. added release notes for bugfix releases 2.1.3 and 2.2.1 (details)
654. fixed sidebar order (details)
655. adjusted release notes wording on update of logback (details)
656. Issue #106: Do not send error responses via WebSocket for invalid live command responses. (details)
657. Issue #106: Use appropriate logger for handling `AddConnectionLogEntry`. (details)
658. Review HttpStatus validation in command responses (details)
659. [#1228] Converge ResponseReceiver and Sender paths for live and smart-channel commands; fix receive timeout of AbstractHttpRequestActor. (details)
660. [#1228] renamed MiscPlaceholder to TimePlaceholder (details)
661. [#1228] removed test which is no longer valid (details)
662. [#1228] Set originator header for live responses in the smart channel; fix unit tests. (details)
663. Use npipe to communicate with docker daemon (details)
664. [#1228] documentation review: (details)
665. Issue #106: Unmute new yet unregistered loggers if connection logs are enabled for the connection. (details)
666. Make connection metric alerting connection type dependant (details)
667. [#1228] renamed header "on-live-channel-timeout" to "live-channel-timeout-strategy" (details)
668. Fixes #1247: allow usage of absolute domain paths ending with a "." as Kafka bootstrap servers (details)
669. [#1228] remove unused second component of response receiver cache; turn the cache into an actor system extension to avoid cross-contamination between unit tests; remove workaround in SmartChannelSelectionWithResponseReceiverTest. (details)
670. [#1228] added blogpost about "live-channel-condition" (details)
671. update Akka to 2.6.18 and logback to 1.2.9 (details)
672. [#1228] review: minor javadoc fixes / parameter renamings (details)
673. [#1228] throw new added LiveChannelConditionNotAllowedException when the "live-channel-condition" is used for non-ThingQueryCommands (details)
674. Issue #106: Handle IllegalAdaptableException for live responses via Connectivity. (details)
675. Issue #106: Smaller fixes before for PR. (details)
676. [#1228]: Adjusted formatting of DittoHeaderDefinition. (details)
677. [#1228]: Fixed some code smells. (details)
678. [#1228]: Mainly code formatting and adjustment of one test case. (details)
679. [#1228] added notice that for "live" channel the device must understand and respond in Ditto Protocol (details)
680. [#1228] Review: rephrase to emphasize that live-channel-condition is a different query parameter from the condition query parameter. (details)
681. [#1228] Interpret smart channel responses as "live-response" (details)
682. [#1228] also start AcknowledgementAggregatorActor for "smart channel commands" + validate command responses also for those (details)
683. review: (details)
684. made "topicPath" in IllegalAdaptableException non-optional (details)
685. Removed publicly unused static factory method for builder. (details)
686. fixed LogEntryFactoryTest (details)
687. Add test to demonstrate persistence of javascript global variables. (details)
688. Move javascript racing tests to mapping processors. (details)
689. Remove the possibility of concurrent modification of global variables in a javascript mapper. (details)
690. Document why InboundMappingSink and OutboundMappingProcessorActor take multiple mapping processors to create. (details)
691. Use non deprecated lazy source initializer (details)
692. Adjust license header to 2022 (details)
693. Add 2022 license for license check (details)
694. update jackson-bom version to 2.12.6 (details)
695. update more dependencies: typesafe-config, ssl-config-core, hivemq-mqtt-client, mongo-java-driver, netty, cloudevents, slf4j, logback, caffeine, classindex (details)
696. wait for kafka client consumer and producer actors initialization to be sure any authentication errors are handled with backoff (details)
697. added Ditto 2.2.2 relase notes (details)
698. wait for success messages in tests (details)
699. fix mock mapper (details)
700. make init timeout configurable for kafka producer and consumer (details)
701. test if Rhino 1.7.14-RC1 breaks things for us or not (details)
702. enhanced JavaScriptMessageMapperRhinoTest with new Rhino 1.7.14 functionality: using template literals (details)
703. update to released Rhino 1.7.14 (details)
704. update Akka Management to 1.1.2 (details)
705. implement support for wildcard (*) in selected fields for RetrieveThing, SudoRetrieveThing and RetrieveFeatures (details)
706. fix unit test (details)
707. review: (details)
708. document not to use '*' as feature ID in basic-feature.md; (details)
709. Avoid passing the context in AcknowledgementForwarderActorStarter (details)
710. fixed/simplified using multiple MappingProcessors via construct "concatLazy(Source.lazySource())" with a simpler and more efficient operation (details)
711. Replace client actor refs refreshing mechanism (details)
712. document field selector with wildcard and extraFields with wildcard; (details)
713. Add counter for connectivity acks to measure messages waiting for acks in a given moment (details)
714. fixed "live-channel-timeout-strategy" OpenAPI documentation (details)
715. configured the default "processorPoolSize" of new connections to 1 (details)
716. fixed ImmutableConnectionTest (details)
717. introduce caffeine cache to cache oauth tokens for http push connections (details)
718. rephrase docu; (details)
719. only sync actors with aggregation actor for more than one client (details)
720. stabilize tests for expiring JWTs (details)
721. use http-push dispatcher for requests to token endpoint (details)
722. move common functionality of expanding feature id wildcard to ThingFieldSelector class and adapt code where the functionality is used (details)
723. Allow to disable automatic passivation for specific shard regions (details)
724. extend selectable fields with "__lifecycle"; (details)
725. Issue #1273: Deal with unavailable Kafka broker in KafkaPublisherActor. (details)
726. moved feature id wildcard expansion logic into ThingsModelFactory; (details)
727. Issue #1273: Moved logic for escalating connection failure to avoid unwanted side effects. (details)
728. fix that very actively updates things indexed in the search could have a wrong search index (details)
729. improve documentation about OpenId connect issuer configuration (details)
730. Add sync between pubsub ddata and cluster state. (details)
731. Add unit test for cluster state sync. (details)
732. Fix license header year. (details)
733. make HealthSignal serializable by implementing marker interface AkkaJacksonCborSerializable (details)
734. Make ClientActorRefs serializable so we can send this directly instead of (details)
735. Add serialization test for ClientActorRefs (details)
736. Simplified serialization test a bit. (details)
737. Add a random delay to ThingUpdater force-update-after-start-timeout to avoid load spikes. (details)
738. * update source and target level to 17, update maven-plugins and dependencies. (details)
739. review: just minor formating / javadoc fixes (details)
740. Issue #1283: Use JDK 17 for github actions build (details)
741. #1283: use jdk17 docker base images (details)
742. fix infinite loop (details)
743. use ThreadSafeDittoLogger for KafkaMessageTransformer; (details)
744. add AcknowledgementAggregatorActor to EXCLUDED_ADDRESS_REPORTING_CHILD_NAME_PATTERN to avoid warning logs; (details)
745. enabled ditto-placeholders japicmp comparison (details)
746. prepare Ditto 2.3.0 release and release notes, blogpost, etc. (details)
747. set next "binary-compatibility-check.version" to released 2.3.0 (details)
748. add content-type to very beginning of protocol-specification.md (details)
749. Test and fix false positives of ClusterStateSyncBehavior due to unserialized local actor refs. (details)
750. fix that placeholder `time:now` did not resolve to the current time when used in a connection's headerMapping (details)
751. ThingUpdater: execute force-update-after-start without waiting for the next event. (details)
752. Add pipeline execution for array values and introduce fn:split() function (details)
753. Allow to use fn:filter() on previous pipeline elements (details)
754. use all available placeholders for HttpPushValidator and AbstractMqttValidator like in the other validators; (details)
755. replace deprecated Akka config "passivate-idle-entity-after" with "passivation.strategy" (details)
756. remove requesting an acknowledgement for UpdateThing command and do not report inconsistent things in search health status (details)
757. add test cases for entity and connection id placeholder in Mqtt3ValidatorTest and HttpPushValidatorTest; (details)
758. remove obsolete unit test, functionality was removed (details)
759. Add filter for search index diff updates on revision. Trigger force update on mismatch. (details)
760. Search update: Remove unused imports; remove errors from missed update detection. (details)
761. fixed that JSON `null` in "correlation-id" of Ditto Protocol headers were parsed as JSON String `"null"` (details)
762. Add counters to track various kinds of search updates. (details)
763. fixed that CommandAndCommandResponseMatchingValidator.validateCorrelationIdsMatch also match when the correlation-id of a commandResponse starts with the correlation-id of the command (details)
764. optimized signal header setting logic (details)
765. Add feature toggle for force-update-after-start. (details)
766. Add OR operator to fn:filter(like) operator (details)
767. review: minor style fixes; removed non-needed imports (details)
768. Refactory away an AtomicBoolean in ResponseReceiverCache. (details)
769. fix that creating policy was wrapped in "ask with retry" setup - this is wrong as create is idempotent (details)
770. added Ditto release notes for version 2.3.1 (details)
771. Remove left-over tagging for waiting ack counter (details)
772. Ignore DittoMessageMapper for hono delivery failed notifications (details)
773. isPatchUpdate would always be false (details)
774. ThingDeleted event did not result in ThingDeletedModel (details)
775. Don't expect a writeModelCount for ThingDeleteModel (details)
776. Add test validating KafkaProducerStream restart on error. (details)
777. bugfix: fixed that LiveSignalEnforcement.handleAskTimeoutForCommand() threw a 503 (ThingNotAvailable) exception and caused a race condition against a "graceful timeout" (details)
778. Add tests for filtering of expired inbound Kafka messages (details)
779. Add HttpPushSpecificConfig to enable custom idle timeout configuration per connection (details)
780. Add Switch to Java 17 to ditto release notes (details)
781. fn:split() review: (details)
782. document 'is-group-topic' and 'aggregate' header for piggyback commands; (details)
783. set "is-group-topic" to true for some piggyback command examples; (details)
784. fn:split() review: (details)
785. fn:filter() review: adjusted signature text to state that first parameter is optional (details)
786. review: minor code formatting changes; (details)
787. first check for incorrect patch update in the if branch; (details)
788. added documentation for OpenId Connect "jwt:" placeholder and new "fn:split()" function applicable for that placeholder (details)
789. Add existing HTTP Push specific config items to HttpPushSpecificConfig (details)
790. made defaults for "max-source-number" and "max-target-number" for connections explicit in config (details)
791. review: adjusted/fixed log templates (details)
792. Add comma (details)
793. added release notes for Ditto 2.3.2 (details)
794. added release notes for Ditto 2.3.2 to sidebar (details)
795. update mutability detector and re-enable all mutability tests (details)
796. fixed that search updater did too much patch failures due to recovery bug (details)
797. reduce receiveTimeout to 5 seconds after a ThingDeleted event was consumed in ThingUpdater to quickly shut it down (details)
798. enhanced test by asserting for the recovered write model (details)
799. review: (details)
800. adapt deployments to java 17 hotspot (details)
801. fix dockerfile-release (details)
802. Add some description to more complex DittoJwtAuthorizationSubjectsProviderTest cases (details)
803. Also update thingRevision and policyRevision on recovery of ThingUpdater (details)
804. Add documentation on fn:filter RQL functions (details)
805. fix compilation error (details)
806. add more debug logs to SshTunnelActor; (details)
807. Remove custom JAVA_OPTIONS in favor of standardized JAVA_TOOL_OPTIONS (details)
808. Consider devops request as authorized if no subjects are expected (details)
809. added more Grafana dashboards as templates (details)
810. delete replaced Hot_Entities.json dashboard (details)
811. adapt log level to warn in case the SSH tunnel failed; (details)
812. [#1034] added ditto-wot-model modules containing interfaces with the WoT TD/TM top-level properties (details)
813. [#1034] added generation for "instance" version for TDs - simply copying the "model" version (details)
814. install wget during setup (details)
815. remove new line at last command (details)
816. [#1034] added documentation, example and a blogpost describing the new added WoT integration in Ditto (details)
817. [#1034] made TM placeholders resolvement required, failing with a 400 bad request (details)
818. [#1034] fixed doc error (details)
819. Enhance logging for mapper instantiation (details)
820. [#1034] added section about TM modeling good practices (details)
821. [#1034] added section about public available ontologies (details)
822. Enhance logs for mapper registration (details)
823. Fix some tests for build on windows and raise version for maven deploy plugin (details)
824. remove test jar from connectivity service module (details)
825. configure classesDirectory for failsafe plugin explicitly for connectivity service (target/classes directory is missing in test classpath otherwise) (details)
826. use same version as defined in the parent pom (details)
827. fixed that ThingUpdater was already stopped when processing "ThingDeleted" events with a consistency-lag > 5 seconds (details)
828. update prerequisites in order to build Ditto (details)
829. added license headers to run config files (details)
830. improved logging for search "bulkWrite": show included correlation-ids in a bulkWrite DEBUG statement when debug logging is activated (details)
831. improved logging statement to include thingIds + BSON filter as well (details)
832. fixed potential NPE (details)
833. fixed some method names and log statements (details)
834. Implement config for toggling whether messages whose enrichment failed should be published anyways (details)
835. Remove unnecessary option (details)
836. Start policies service at first to make sure cluster can be built as soon as possible (details)
837. Adapt documentation for building ditto (details)
838. Issue failed acks for failed enrichments (details)
839. improve logging of ThingUpdater etc. in order to be better able to find out which changne caused a "failed patch update" (details)
840. fix parallel execution issues in ThingUpdater/MongoSearchUpdaterFlow (details)
841. added unit test ThingUpdaterTest.parallelUpdatesProvokingIncorrectPatchUpdate in order to test bugfix for parallelism problems in ThingUpdater (details)
842. fixed behavior switch which did not handle too many messages in the previous "awaitingBulkWriteResult" (details)
843. reduce logging when stashing WriteModels (details)
844. improved logging for queries and counts in SearchActor (details)
845. fix toString() methods of various model classes (details)
846. [#1034] added WoT Discovery compatible API for GET /api/2/things to retrieve a list of TDs - including adding "Links" as http headers for the "next" page (details)
847. [#1034] added documentation about enhanced SSE features coming with this PR (details)
848. [#1034] fixed RootRouteTest (details)
849. filter for incorrect element types in jsonArray of feature definitions; (details)
850. added possibility to add JVM options for e.g. specifying "--add-opens" for ditto-connectivity required with Java 17 (details)
851. simplify maven.yml GitHub action: (details)
852. updated legal information after updating lots of dependencies for Java 17 (details)
853. fix using environment vars in docker-nightly.yml (details)
854. fixed JVM_CMD_ARGS invalid quotation (details)
855. added "restart" policy "always" to docker-compose (details)
856. added platform linux/arm/v7 in nightly image build (details)
857. Invalidate ResponseReceiver cache after a response is received. (details)
858. fixed/improved JVM settings of sandbox + example k8s descriptor files (details)
859. fixup some READMEs in deployment section, adding system requirements (details)
860. remove "linux/arm/v7" from supported platforms in nightly docker build again (details)
861. remove throttling limits currently in place by default for Ditto: (details)
862. introduced explicit "enabled" option for ThrottlingConfig and by default disable it in Ditto (details)
863. update jruby used in maven-gem-plugin to latest 9.3.3.0 in order to get it running with Java 17 JDK (details)
864. simplified jsonString checking logic when creating a FeatureDefinition from a `featureDefinitionEntriesAsJsonArray` (details)
865. fixed WARNING logging in RequestTimeoutHandlingDirective to log warnings for search requests only > 5s (details)
866. update scala version to 2.13.8 and fluency to 2.6.3 (details)
867. made Kafka client "session.timeout.ms" and "heartbeat.interval.ms" explicit in Ditto config (details)
868. removed file name config from logback.xml because of a bug in logback core which causes the creation of tmp files that are never deleted; (details)
869. update docu for use of DITTO_LOGGING_TOTAL_LOG_FILE_SIZE in installation-operating.md; (details)
870. extend documentation for use of Ditto log file feature; (details)
871. remove uncommented line and fix fileNamePattern of concierge logback.xml; (details)
872. don't run parallel maven build (details)
873. fixed placeholder resolvment in "commandHeaders" of "ImplicitThingCreation" mapper (details)
874. small adjustments to the wot documentation (details)
875. fixed default docker-compose.yml (details)
876. Delete unnecessary blank space (details)
877. Adjust PlaceholderResolver to resolve a placeholder to multiple values (details)
878. fixed SSE route get/accept order (details)
879. Change Placeholder interface to resolve to a List of Strings instead of (details)
880. fixed AbstractRoute response transformation (details)
881. Simplify API of PipelineElement to allow to resolve to a single value and avoid having Collections.singletonList all over the place (details)
882. remove unused imports (details)
883. adapt javadoc and delete unused code (details)
884. updated Readme to not trap newcomers in building Ditto (details)
885. enable experimental WoT integration in sandbox (details)
886. Add MetricsAlertGauge to handle throttle events for in flight message gauge (details)
887. fix japicmp maven plugin to actually check api compatibility again (details)
888. Restore API as deprecated (details)
889. updated japicmp plugin version to correctly handle OSGi bundles again (details)
890. Use all authorization subjects as resolved values (details)
891. Minor adaptions after review (details)
892. review: small improvement to CounterKey creation (details)
893. split up the "policy enforcer cache" and the "thing cache" configuration in search (details)
894. review: fixed test name (details)
895. review: fix javadoc (details)
896. Revert "review: fix javadoc" (details)
897. review: fix javadoc (details)
898. Adapted usage of placeholders to make use of multiple resolved values where possible (details)
899. Adjust logging/ add test (details)
900. Adapt FeaturePlaceholder to be able to handle Signals (details)
901. Handle ModifyThing command in FeaturePlaceholder (details)
902. Handle all kinds of ThingModifyCommand/ThingModifiedEvent/ThingModifiedCommandResponse (details)
903. Fix logging and comments (details)
904. Enabled Placeholder resolving for extra fields declaration in connectivity (details)
905. Adds missing getEntity implementation for ThingMerged (details)
906. enhanced connectivity model by RecoveryStatus and provided it accordingly (details)
907. improvement OutboundMappingProcessorActor logging by adding the connectionId to the MDC (details)
908. fix unittest (details)
909. Enable placeholder resolving for extra field declaration in gateway (details)
910. added logging of entityId for "Publishing mapped message" log message (details)
911. Use internal correlation-id for outbound mapping. (details)
912. fix lincese header issue on github (details)
913. fix license header issue on github (details)
914. added unittest for connection RecoveryStatus (details)
915. fixed that for empty BulkUpdate no "BulkWriteComplete" was sent back to ThingUpdaters (details)
916. improved debug log to include used strategy class name (details)
917. improved "Dropped message!" log error message (details)
918. bump swagger-ui version to 4.6.1 and ngninx version to 1.21-alpine; (details)
919. fix sending BulkWriteComplete message for all cases (details)
920. fix JsonValue.asString() invocation when value was no string (e.g. `null`) (details)
921. Allow placeholders in JsonFieldSelectors (details)
922. fixed parallelism issues in search-updater bulk-writes coming from the same thing (details)
923. added OpenAPI support for "Accept: application/td+json" by adding it as possible response (details)
924. fixed that "async" parallelism must be power of two - so don't use "maxBulkSize" for that (details)
925. merge substreams before executing bulkWrite (details)
926. added sandbox configuration for correct WoT base prefix (details)
927. don't apply and provide precondition headers when serving WoT TDs (details)
928. Describe general available placeholders (details)
929. Reference described placeholders instead of repeating their explanation (details)
930. Document that and which placeholders can be used for declaring extra fields (details)
931. added configuration for "bulk-shard-count" used to determine how many substreams based on the thingId hash should be started for bulk updates (details)
932. review: small code improvement; (details)
933. [#1332] incorporated feedback on WoT blogpost + documentation (details)
934. Validate extra field declaration when subscribing via SSE/Websocket (details)
935. added properties for wot TD in OpenAPI doc (details)
936. merging substream after flatMapMerge (details)
937. Add test for validating search consistency in case of conflicting search updaters (details)
938. don't build documentation for Ditto feature branches (details)
939. don't build documentation in feature branch builds (details)
940. Decrease Consistency-IT timeout (details)
941. Revert "Decrease Consistency-IT timeout" (details)
942. Add test to demonstrate message reordering in EnforcementFlow. (details)
943. Move "groupBy" operator in EnforcementFlow in order to avoid message reordering. (details)
944. Remove bulk-shard-count. (details)
945. Sort each batch update by sequence number to prevent reordering before diff computation. (details)
946. EnforcementFlowTest: Isolate actor systems for each test; remove unused method. (details)
947. Fix "Head of empty stream" error in EnforcementFlow. (details)
948. Fix stalling due to bulk collection in updater stream. (details)
949. Increase timeout in EnforcementFlowTest. (details)
950. Switch to OpenJ9 for Github actions. (details)
951. Switch to Temurin for Github action. (details)
952. Remove unused environment variable. (details)
953. Update maven.yml (details)
954. Skip EnforcementFlowTest.updateDoNotGetReordered. (details)
955. write add-opens to manifest so its not needed in the docker images (details)
956. removed no longer used "search-updater-dispatcher" (details)
957. removed no longer used "search-updater-dispatcher" (details)
958. bring back add-opens to connectivity run configuration (details)
959. Switch to OpenJ9 for Github actions. (details)
960. Switch to Temurin for Github action. (details)
961. Remove unused environment variable. (details)
962. Skip EnforcementFlowTest.updateDoNotGetReordered. (details)
963. simplified ChangeQueueActor outcome to Collection<Metadata> instead of Map<ThingId, Metadata> (details)
964. fixed that ThingDeleted events could run into situations where the search-index would not process this event (details)
965. Only retry patch updates in a batch with incorrect updates. (details)
966. Restore effectiveness of bulk size configuration. (details)
967. Add test to validate preservation of bulk size. (details)
968. use test.conf in SearchConsistencyIT; (details)
969. review: minor formatting + added logs for when ThingDeleteModel is produced in EnforcementFlow (details)
970. Don't rely on field order for SearchConsistencyIT assertions (details)
971. review: code format and use predefined constant; (details)
972. ThingUpdater: Skip outdated updates. (details)
973. Add class to calculate a JSON merge patch between to JSON values (details)
974. fixed compile error after merge (details)
975. Skip EnforcementFlowTest.thereCanBeMultipleUpdatesPerBulk for Github. (details)
976. Fix review findings (details)
977. Make JsonMergePatch more objekt oriented (details)
978. remove since annotation from methods because the whole class was introduced in 2.4.0 (details)
979. simplify if condition (details)
980. fix generation of code coverage reporting; (details)
981. Fix namespaced entity ID regex in documentation (details)
982. Simplified EntityName regex which was overly complex (details)
983. Remove unnecessary escaping (details)
984. remove unnecessary grouping (details)
985. Update documentation according to changes in the regex (details)
986. Fix japicmp plugin (details)
987. update nexus-staging-maven-plugin to latest (details)
988. Extract delegating part of ImmutablePolicyBuilderLabelScoped to abstract class to allow reuse (details)
989. Add missing javadoc (details)
990. #1345 fixed fn:substring-after assuming delimiter is only 1 character (details)
991. update dependencies 2022/03 (details)
992. review commits (details)
993. improved search-updater logic by: (details)
994. follow redirects when fetching WoT TMs via HTTP (details)
995. re-added publishing PolicyEvent in PolicyPersistenceActor + adjusted test to fish for event (details)
996. fix inverted isEmpty check (details)
997. added healthchecks to docker-compose.yml (details)
998. add code of conduct (details)
999. fixed file ending to .md (details)
1000. added releasenotes and blogpost for Ditto 2.4.0 (details)
1001. fix that "version" in ditto header defines that it can take 1 or 2 .. (details)
1002. add QUERY_CONFIG_ENABLED to swagger-ui in kubernetes and docker-compose directory; (details)
1003. adapt documentation to review findings (details)
1004. Fix rendering issues of documentation (details)
1005. Avoid exception, when no values could be resolved (details)
1006. Skip validation of THingFieldSelector when it contains a placeholder (details)
1007. Use same validation for fromString (details)
1008. Handle empty field selectors for signal enrichment in Gateway (details)
1009. Remove Optional from connection throttling message (details)
1010. fix messages documentation which states that consuming messages is only possible via WebSocket (details)
1011. Add field selector for RetrievePolicy command (details)
1012. Add documentation about field selection for RetrievePolicy (details)
1013. review: deprecate WithSelectedFields in things model in favor in same interface in base model (details)
1014. review: revert imports of WithSelectedFields interface to prevent api break (details)
1015. add logger to TunnelChannelListener and extended logging for channel initialized, state changed and open success; (details)
1016. fixed disabling/enabling logging to `SYSOUT` mechanism by checking for content of environment variable `DITTO_LOGGING_DISABLE_SYSOUT_LOG` (details)
1017. fix for IllegalArgumentException thrown when calling newMultiMappedOutboundSignal (details)
1018. configured healthcheck for nginx in sandbox + added "autoheal" service which automatically restarts unhealthy services via docker (details)
1019. update nginx of sandbox to 1.21-alpine (details)
1020. adjust `DITTO_LOGGING_FILE_APPENDER` env key to be "true" so that file appender is used (details)
1021. Adapt documentation for enrichment with placeholders (details)
1022. add workaround for Rebex SSH server (described workaround in code); (details)
1023. renamed varibale to initialSshChannelWindowSize and adapt comment for workaround; (details)
1024. updated outlook for Ditto 2.5.0 and 3.0.0 (details)

speed up validation of message path

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

Do not publish SubjectDeletedAnnouncement for updated subjects.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

#1135 implement basic tracing (using w3c trace context and kamon-opentelemetry), add dependency to kamon-opentelemetry, extend existing DittoMetrics timer to also create a trace, add rudimentary tracing (at least one trace per service) and read/propagate trace context at the edges (gateway/connectivity)

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

#1135 document tracing configuration

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

Add feature toggle for when-deleted subject announcements.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

fix bug in message path validation and add tests

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

Resolve connectivity status from given exception for all client actors

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

Remove TimeMeasuringFlow.

Reason: It is not possible to maintain timer accuracy and remove
back pressure from timers at the same time.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

added new MDC key "ditto-log-tag" used in Connection live status logs + switched misconfiguration to "warning" level

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

#1135 make activiation of tracing configurable (generation of trace spans/context propagation)

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

added "connection-id" MDC entry which got lost otherwise

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

#1135 move tracing out of the metrics timer and provide a DittoTracing.wrapTimer instead

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

review: made ImmutableConnectionFailurand ImmutableClientDisconnected package private, pulled static creators to interfaces
* disabled parallel stream processing in UserIndicatedErrors and made the underlying structure a List instead of an Iterable
* stabilized KafkaClientActorTest

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

review: added ConnectivityStatusResolver to BaseConsumerActor in order to resolve status in KafkaConsumer
* added ConnectivityStatusResolver to SshTunnelActor in order to resolve status

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

Switch to info level for misconfigured connectivity status

* I try to avoid unnecessary warn logs
* For the purpose of using this log as source for a monitoring
  I used the live status in the ditto-log-tag mdc

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

Set connection status on every failure backoff based on the ConnectionFailure

* This is required because if one timeout happened during reconnect
  any failure reason during further reconnect was ignored.

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

#1135 fix default channel in tracing config, add unit tests for context extraction/propagation

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

handle 'canConnectViaSocket' for reconnect

* Should go to connecting state with MISCONFIGURED status

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

#1135 enclose tests for disabled tracing

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

Treat kafka authenticaiton exceptions as user inidcated errors

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

fixed duplicated throwable.getMessage() "statusDetails" error discription for JMS/AMQP1.0 errors

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

added MQTT exceptions to "user-indicated-errors"
* harmonized "ConnectionStatusDetails" string by pulling out static helper to ConnectionFailure interface
* improved on formatting of the "ConnectionStatusDetails"
* for manually set "misconfigured" status, create a more helpful "ConnectionStatusDetails" message

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

added "connection-type" MDC for live-status log statements

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

Allow to enhance the coded config list by specifying environment variables

* e.g USER_INDICATED_ERRORS.0={exceptionName:"my.Exception", messagePattern: ".*"}

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

Fix hard-coded headers for HTTP protocol check.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

Configure exceptions for RabbitMQ that should be treated as user failure

* Authentication failure is a user mistake
* ShutdownSignalException indicates for example that the path is wrongly
  configured.

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

treat javax.net.ssl.SSLException as user failure

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

review: added unit test in UserIndicatedErrorsTest testing the environment variable parsing of string objects

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

additionally added configuration overwrites via system properties to make unit test run on Jenkins and via maven as well

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

added timeout behavior to RetrieveConnectionStatusAggregatorActor:
* for timed out responses, add the timed out clients/sources/targets with "failed" state and a timeout description to the RetrieveConnectionStatusResponse
* changed some log statements from logging "JMS" to "AMQP 1.0"
* fixed that for "targets" the connection-id was used "client" identification and not the instance-id
* switched around that "failure" now is stronger than "misconfigured" when determining the overall live status

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

added timeouts multiple times if > 1 timeout was encountered; niceified code

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

Categorize ssh tunnel exceptions

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

tracing review:
* fixed that for TraceTags.connectionType the wrong tracing tag "commandType" instead of "connectionType" was used
* added tracing for "persist.event" in AbstractShardedPersistenceActor
* added tracing for Websocket/SSE
* in AbstractJsonifiableWithDittoHeadersSerializer, renamed traces to "serialize" and "deserialize" + use the earliest possible start timestamp for measuring
* added missing javadocs in new tracing APIs
* fixed license header years for new files

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

Add OpenAPI documentation about status 424 in messages routes.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

Add 424 responses to all requests that can request acknowledgements.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

update docker base image version to newest openj9 version;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

initial documentation of conditional updates;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

extend javadoc with ParserException;
removed unused import;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

[#559] add conditionParam.yml and add reference in all thing resources;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

use ThreadSafeDittoLoggingAdapter in ThingsAggregatorActor;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

remove dependency to ditto-base-model in ditto-rql-model because it is not used;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

[#559] add condition header to DittoHeaderDefinition;
extend AbstractDittoHeaders, AbstractDittoHeadersBuilder, DittoHeaders and DittoHeadersBuilder for new condition header;
add Condition class and unit test;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

[#559] fix ImmutableDittoHeadersTest;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

Test that subjects containing slashes cannot be deserialized as Adaptable.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

Fix parsing of slashes in topic or path of Ditto protocol messages.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

Handle topic path starting with "/".

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

[#559] condition can be specified as query parameter and http header;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

[#559] extend unit test QueryParametersToHeadersMapTest;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

Reintroduce message path prefix validation for policy and thing message signals.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

Fix missing "extra" field in DittoProtocolAdapter#fromAdaptable.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

Add option to delete search entries immediately.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

Improve resilience of authentication chain.

- Synchronous or asynchronously thrown exceptions no longer abort
  the authentication chain.

- Fixed concurrent modification of authentication result.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

Do not log a stream completion exception as failed message consumption

* This will appear as failure in the connection metrics for consumed messages
  which is wrong because it's not related to a consumed message

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

reflect consumer failure in connection status

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

make fileNamePattern configurable via env variable;
document new env var DITTO_LOGGING_FILE_NAME_PATTERN;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

Add common certificate exceptions

* Found mqtt connections on AWS that have this issue

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

Add at least one cause for a failed source to the ConnectionFailedException

* This is required to declare the root cause as user indicated failure

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

Add missing mqtt exceptions

* One for invalid certificates
* One for the situation when a wrong port is configured

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

Improve resilience of DittoRuntimeExceptionToErrorResponseFunction.

Fix cascading throws when transforming entity ID invalid exceptions.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

Add log to analyze reasons of JMS errors

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

Invalid destinations are a user failure

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

[#559] implement conditional requests based on the condition in the ditto headers;
add AbstractConditionCheckingCommandStrategy which checks the specified condition against the actual thing state;
add new exception ThingConditionFailedException;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

Minor code changes during review

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

[#559] fix broken test in ImmutableDittoHeadersTest;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

[#559] rework implementation of condition checking;
add ThingConditionValidator which is validating the specified condition on the thing;
removed AbstractConditionCheckingCommandStrategy;
add ThingConditionValidatorTest;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

[#559] add ThingConditionValidator;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

Fix enforcement timers not being stopped when filtered in pre-enforcer.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

Upgrade Akka libraries.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

Extend signal enrichment facade for search update; fix interpretation of delete events.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

Use CachingSignalEnrichmentFacade for search index update.

- Removed priority for control messages in ChanngeQueueActor in
  order to aggregate updates better.

- Remove deprecated method use in BulkWriteResultAckFlowTest.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

Replace unnecessary SudoRetrieveThingResponse in EnforcementFlow; fix ThingUpdaterTest.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

use same version property for all kamon dependencies

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

add OnStopHandler again as functional interface

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

add tracing for enforcement (timer was removed from AbstractEnforcerActor on master)

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

Enhance piggyback command responses with service and instance info.

- Add ExecutePiggybackCommandResponse in order to relay service
  and instance information back to Gateway.

- Read the expected number of responses from cluster state in order
  to reduce wait time for DevOps commands.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

[#559] remove Condition class because no central validation of the specified condition is possible;
pass the condition in the dittoHeaders as string;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

[#559] introduce new FieldNamesPredicateVisitor to be able to extract the fieldNames from RQL expression;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

[#559] check read permission on all resource keys specified in the condition;
add unit test to ThingCommandEnforcementTest;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>