Changes

Summary

1. prepared Ditto 2.0.0 release notes + announcement blogpost (details)
2. Open and create connection with automated logging activation (details)
3. Fix test when open connection with automated logging activation (details)
4. Mention that connection logging is enabled when opening or creating connection (details)
5. Fix test for logging enabling (details)
6. Issue #1043: Moved `EmptyTopicPath` from `ImmutableTopicPathBuilder` to package level. Added a unit test. (details)
7. updated release notes with the current module/package structure (details)
8. documented removal of "x-ditto-dummy-auth" header (details)
9. updated renamed modules/packages (details)
10. Issue #1043: Reduced too high amount of constructor arguments of `ImmutableTopicPath`. (details)
11. Issue #1043: Added methods for easier evaluation of `TopicPath`. (details)
12. Issue #1043: Replaced equality checks with call to `is...` methods of `TopicPath`. (details)
13. Issue #1043: Fixed result creation of `ImmutableTopicPath#getPath()` and added a unit test that covers an empty namespace part. (details)
14. update maven packages names in maven structure overview; (details)
15. improve release announcement and release notes; (details)
16. fiy typo; (details)
17. Issue #1043: Set '@since' version to 2.0.0. (details)
18. Issue #1043: Removed empty topic path and its usage. Ditto Protocol messages are always required to have a topic. Thus an empty topic path implementation did not make sense. (details)
19. Issue #1043: Added missing 'package-info' files to packages to add `@Nullable` annotations. (details)
20. Issue #1043: Fixed Javadoc comment. (details)
21. Add connectivity announcements for when a connection was opened or closed (details)
22. Issue #1043: Refactored `AbstractAdapter`. (details)
23. fixed GitHub actions (dockerfiles were moved) (details)
24. Issue #1043: Re-added missing 'package-info' files to packages to add `@Nullable` annotations. (details)
25. Issue #1043: Fixed compilation errors after merging master branch. (details)
26. added ditto-things-model and ditto-policies-model as explicit dependencies to ditto-protocol (details)
27. Issue #1043: Fixed invalid reference in Javadoc. (details)
28. changed scope to compile for ditto-internal-utils-persistence (details)
29. temporary ignore TimeMeasuringFlowTests (details)
30. Issue 1043 fix minor misspelling as part of review (details)
31. Add connectivity announcements to the ditto protocol (details)
32. added "akka-discovery-kubernetes-api" and "akka-lease-kubernetes" dependencies to ditto-base-service so that all services depend on it (details)
33. stabilize PolicyPersistenceActorTest by waiting for at least once for deletion announcement (details)
34. stabilize ConnectionPersistenceActorTest EnableConnectionLogs related test instabilities (details)
35. Also resolve connectivity signals from Adaptables (details)
36. stabilize ConnectionPersistenceActorTest EnableConnectionLogs related test instabilities, part 2 (details)
37. Add connection announcements to the Topic (details)
38. made EmptyEvent no longer implement WithEntityId (details)
39. stabilize ConnectionPersistenceActorTest EnableConnectionLogs related test instabilities, part 3 (details)
40. Add connection announcements to the signal filter (details)
41. fix MQTT publisher warnings when no MQTT consumer was present (details)
42. Don't subscribe to internal Ditto PubSub for connectivity announcements as they are only sent outwards (details)
43. redact sensitive parameter/header values before logging (details)
44. fixed some sonar issues and typos; (details)
45. don't calculate filteredRawRequestUri if debug logging was not activated (details)
46. updated date of release 2.0 in docs (details)
47. fixed javadoc errors discovered in release build (details)
48. added Ditto 2.0 to documentation version picker (details)
49. activate binary compatibility check to version 2.0.0 (details)
50. added Ditto 2.0.x to SECURITY.md (details)
51. restructure kubernetes deployment Readmes; (details)
52. bump nginx version to 1.20-alpine; (details)
53. #1052: Fix typo (details)
54. Send connection announcement after opening and before closing a connection (details)
55. Close connections when shutting down the the cluster (which will trigger sending a close announcement) (details)
56. Close connection before deleting it (which will automatically send a connection announcement) (details)
57. fix ErrorHandlingActorTest (details)
58. Avoids throwing exceptions in ditto metrics and return more or less (details)
59. fixed typo in 2.0 announcement (details)
60. only log warning if already stopped timer should be stopped (details)
61. fixed parallelism of search-updater using "flatMapMerge" (details)
62. added custom dispatchers for flatMapMerge() with async() usage in (details)
63. fixed EnforcementFlowTest (details)
64. added missing dispatcher to search test config (details)
65. fixed SearchActorIT (details)
66. fixed that Policy Error responses in WS contained wrong topic path (details)
67. #1052: validate that connection announcements can only be used with client count 1 (details)
68. fixed default config of retrieval.parallelism to be a factor of 2 (details)
69. removed .withAttributes(Attributes.inputBuffer from search-updater-flows (details)
70. uncomment resources config for all services; (details)
71. #1052: Add documentation for connection announcement (details)
72. #1052: mention connection announcements in protocol-specification.md (details)
73. relax mqtt validation for source header mappings (details)
74. Fixed missing publish metrics for published messages without (details)
75. 1052: fix wording for connection announcement (details)
76. fixed that for commands requesting "search-persisted" the wrong write concern was used (details)
77. added "docker pulls" badge to readme (details)
78. Issue #1060: add test cases for Azure and AWS signing processes (details)
79. made AckUpdater work with ddata sharding (details)
80. Issue #1060: add azure monitor request signing (details)
81. Issue #1060: Add AwsRequestSigning; switch signing timestamp formatter to DateTimeFormatter; add TODO in AbstractBaseClientActorTest (details)
82. Issue #1060: Add HmacCredentials. (details)
83. Fix broken links in installation-operating.md (details)
84. Implement basic structure for kafka consumers (details)
85. added logging a type hint to AbstractEnforcement successful enforcement (details)
86. put log statements with debug content to DEBUG level (details)
87. Added validation for source address and target header mappings (details)
88. Issue #1060: add dynamic loading of HTTP request signing algorithms. (details)
89. review: fixed comment which still pointed to outdated enum name (details)
90. Handle exceptions in MessageProcessor to avoid exceptions in KafkaStreams (details)
91. Make move the logic again to a transformer (details)
92. use var keyword; (details)
93. Use correct branch names to access them in the map (details)
94. use min interval from backoffConfig to create RestartSettings; (details)
95. Issue #1060: Only validate certificate for client certificate credentials in the absence of server certificate; do not throw UnsupportedOperationsException in other cases. (details)
96. move start of stream to preStart hook (details)
97. move initialisation of logger back to top (details)
98. Use scalas Either to avoid using generic Object as return type (details)
99. WIP: switch to akka-stream-kafka (details)
100. fix MQTT protocol level acknowledgements (details)
101. fixed applying "eventLoopThreads" option (details)
102. #1052: edit documentation for topic path of connection announcements (details)
103. applied manual reconnect for MQTT connections (details)
104. make it possible to write logs to Logstash endpoint; (details)
105. add logstash-logback-encoder and janino dependency; (details)
106. add exclude for shade plugin; (details)
107. add volume and volumeMounts to access ditto log files; (details)
108. #1052 correct year in licence header (details)
109. removed duplicate check for empty failed responses; (details)
110. add missing volumeMounts; (details)
111. add logging possibilities to installation-operating.md; (details)
112. review: prefixed all logging related environment variables with `DITTO_LOGGING_` (details)
113. fixed logback XML error (details)
114. added Ditto 2.0.1 release notes (details)
115. Issue #1060: Support GET method in HTTP connections; support x-amz-content-sha256 in AwsRequestSigning. (details)
116. added a new introduction slide-deck for Eclipse Ditto (details)
117. Issue #1060: Fix xAmzContentSha256 field name; log outgoing HTTP request on DEBUG. (details)
118. Remove not needed hyphen in ditto-cluster.yaml (details)
119. Surround env value with double quotation marks (details)
120. Fix command to start ditto with another version (details)
121. Issue #1060: Log signed requests on DEBUG level. (details)
122. Connectivity: Improve debug log for incoming messages. (details)
123. Fix missing placeholder in debug log. (details)
124. #586 add configuration for kafka consumer, add migration notes for changed kafka configuration (details)
125. Fix parameter passing to payload mapper when topic path contains no channel (details)
126. Append signature topics with undefined channel (details)
127. add logging in case of errors; (details)
128. make ThingPersistenceActorMailbox size configurable via env variable; (details)
129. #1052: correctly deserialize and serialize the parts of a topic for the "none" channel (policies and connections) in the JavaScript mappings (details)
130. #1052: add unit tests verifying correct behaviour of the Ditto JavaScript helper functions for policy and connection announcements (details)
131. Issue #1060: Add missing header for AWS request signing. (details)
132. add debug log for dropped signals, if target address can not be resolved; (details)
133. Issue #1060: render auth parameters without quotes in AwsRequestSigning. (details)
134. split log for targets and replayTarget into separate statements; (details)
135. Issue #1060: Fix AwsRequestSigningTest. (details)
136. #586 use alpakka kafka also for sending messages to kafka cluster, remove dependencies to kafka-clients and kafka-streams, adapt service config and tests (details)
137. Issue #1060: Add reserved HTTP header "http.query" to replace the query string. (details)
138. #1060 fix behaviour on empty path. Add unit tests (details)
139. Issue #1060: Fix double-appending of "/" to empty paths in AwsRequestSigning. (details)
140. Issue #1060: Fix AwsRequestSigningTest again. (details)
141. bump nginx version in docker-compose.yml to 1.20-alpine; (details)
142. add initContainer for nginx to wait for gateway to be available before start up; (details)
143. remove link to /apidoc/1 in index.html in docker and kubernetes; (details)
144. add link to resource quota docu; (details)
145. Issue #1060: Add HMAC credentials to connection schema. (details)
146. Issue #1060: Document HMAC request signing. (details)
147. #586 add throttling config for kafka consumers, resolve defaults for akka.kafka.consumer and akka.kafka.producer (details)
148. Issue #1060: Validate connections with HMAC credentials. (details)
149. #1060: Documentation: add GET as new http verb for http1.1 connections (details)
150. #586 add defaults from reference.conf manually (temp. solution) (details)
151. #1060: add documentation entry for "http.query" header mapping (details)
152. #586 update to akka 2.6.14 (details)
153. #586 configure shade plugin to append version.conf files for connectivity service (akka kafka contains another version.conf) (details)
154. #586 add immutability test and reduced logging for message transformer (details)
155. #1073 reduce logging of JWT parsing/validation errors to not contain stacktrace (details)
156. #586 use defaults from reference.conf (details)
157. omit secrets from toString() outputs of Credentials implementations (details)
158. change directory where ditto log files will be created; (details)
159. change fileNamePattern for TimeBasedRollingPolicy to absolute path; (details)
160. add log file directory to docker image and grabt ditto user write access; (details)
161. add env var DITTO_LOGGING_FILE_APPENDER to docker-compose.yml and create volume to access ditto logs on host machine; (details)
162. don't try to publish ExpiryAnnouncements for new or deleted policies (optimization) (details)
163. fixed imports of ditto-connecticity-model OSGi bundle (details)
164. [#1078] Add AzSaslRequestSigning. (details)
165. added (currently failing) test case for enriching MergeEvents with extra fields using the CachingSignalEnrichmentFacade (details)
166. fixed CachingSignalEnrichmentFacade for ThingMerged events (details)
167. fix docker image name; (details)
168. uncomment resources for easier testing; (details)
169. adjusted example usage of Ditto Java Client (details)
170. [#1078] Add option to set SR in AzSaslRequestSigning. (details)
171. Enable separate configuration for minimum reconnect delay for MQTT broker initiated disconnects of MQTT sessions (details)
172. [#1078] rename "sr" to "endpoint" in AzSaslRequestSigning. (details)
173. fixed test.conf (details)
174. fixed connection-test.conf (details)
175. [#1078] Make "endpoint" of AzSaslRequestSigning mandatory. (details)
176. #1081 add conditioned thing templates list to implicit mapper (details)
177. [#1078] Allow AzSaslRequestSigning to authenticate AMQP 1.0 connections. (details)
178. [#1078] Make JSON field definitions of request signing factories final. (details)
179. [#1078] Fix ConnectionValidatorTest. (details)
180. add pod to initialize ditto logs directory on host vm; (details)
181. use gid 1000 for ditto group; (details)
182. #1081 add exists to filter functions (details)
183. [#1078] Fix AMQP username of AzSaslRequestSigning. (details)
184. [#1078] use DittoDuration format for AzSaslRequestSigning's ttl parameter. (details)
185. rename volume for ditto log files; (details)
186. add prerequisite to documentation for ditto log files; (details)
187. #586 ignore duplicate headers (log warning only), clean up connectivity.conf (details)
188. [#1078] set default TTL of az-sasl to 1 week to prevent cascading backoff. (details)
189. Filter expired messages based on creation-time and ttl headers (details)
190. #586 add entity placeholders to resolver creators to use in kafka targets (details)
191. [#1078] provide actorSystem in ClientActorPropsFactory#getActorPropsForType instead of having it in every DittoService (details)
192. #586 add dispatcher for alpakka kafka (details)
193. #586 use dispatcher only for consuming messages from kafka (details)
194. [#1078] add test for SaslPlainCredentialsSupplier (details)
195. [#1078] split request signing factories into different factories for http push and amqp (details)
196. create $DITTO_HOME and $DITTO_LOGS directory inside the one RUN directive for all dockerfiles; (details)
197. Add documentation for kafka sources (details)
198. [#1078] fix DefaultAmqp10ConfigTest (details)
199. [#1078] Remove test to not verify SSL certificates. (details)
200. [#1078] Restore support of client-certificate credentials with basic-auth for SaslPlainCredentialsSupplier. (details)
201. #586 suffix kafka consumer/producer client ids (details)
202. [#1078] move documentation on HMAC signing onto extra page and reference it from HTTP and AMQP 1.0 bindings. (details)
203. [#1078] add blog post for HMAC signing for HTTP push and AMQP connections (details)
204. fix rounding up "policyExpiryGranularity" to "0" (disabling it) (details)
205. update installation-operating.md; (details)
206. [#1078] update little parts on the documentation of HMAC algorithms (details)
207. [#1078] fix how AMQP connections handle the validateCertificates configuration, which was causing timeouts when connecting to a secured resource with validateCertificates=false. Also re-add the 'testTLSConnectionWithoutCertificateCheck' which verifies the correct behavior for this. (details)
208. [#1078] add HMAC signing to sidebar and include examples section (details)
209. [#1060] Connectivity: Add reserved header http.path to set the path of outgoing HTTP requests. (details)
210. #586 drop consumed messages in dry run mode, disable auto commit in dry run mode (details)
211. [#1078] Fix typos. (details)
212. stabilize coordinated shutdown hook in BaseClientActor for sending connection announcements: (details)
213. update Akka to 2.6.15 and Akka Management to 1.1.0 (details)
214. #586 use streams to publish messages to kafka (details)
215. #586 fix test (details)
216. fix HttpPushFactoryTest by using a parallelism with power of 2 (details)
217. adjusted gateway.conf to let "service-requests-done" coordinated shutdown phase timeout be 12s, 2s longer than the "ditto.gateway.http.coordinated-shutdown-timeout" (details)
218. try to fix EnformcentFlowTest (details)
219. [#1060] Adjust AwsRequestSigning to support S3 better. (details)
220. [#1078] Add cloud integration examples using HMAC. (details)
221. fixed EnforcementFlow parallelism (details)
222. Fix naming (details)
223. downgrade to Akka 2.6.14 again after Akka streams has some changes (or even a bug) to attribute propagation which could lead to a very different behavior (details)
224. enable POST, PUT and DELETE requests for akka management api; (details)
225. [#1088] retry starting BaseClientActors when they fail when being started by the ConnectionPersistenceActor. Escalate failures of the router pool to the supervisor actor which can restart the ConnectionPersistenceActor. (details)
226. updated to Akka 2.6.15 again and fixed EnforcementFlowTest (details)
227. #586 use SendProducer instead of Producer.flexiFlow() to be able to handle the publish errors/acknowledgfements correctly, re-enabled KafkaPublisherActorTest (details)
228. don't remove all other addresses in ClusterMemberRemovedAware when own instance was terminated (details)
229. #586 move producer config to producer section (details)
230. remove non needed Attributes inputBuffer on EnforcementFlow (details)
231. review: made OneForOneEscalateStrategy final + minor javadoc addition (details)
232. #586 send connection failure message to parent if kafka producer stream fails (details)
233. #586 disable parallel publishing, use separate dispatcher for publishing (details)
234. [#1078] rewrite Azure IoT Hub example payload mapping to map the ditto protocol message to a direct method (details)
235. [#1078] fix use of jekylls %raw% in markdown (details)
236. adjusted "role" for all splitBrain resolver configs to be unset (details)
237. [#1078] add az-sasl to connection json in the documentation (details)
238. Adjust documentation for kafka sources (details)
239. #586 add dedicated kafka dispatcher also for unit tests (details)
240. configure "least-shard-allocation-strategy" algorithm in order to get better shard allocation / rebalancing (details)
241. downgrade Akka version to 2.6.13 (details)
242. [#1078] align az-sasl hmac signing examples with the previous examples (details)
243. [#1060] test all paths of reserved headers in HttpPublisherActor (details)
244. #586 restart source if stream fails (details)
245. downgrade Akka Management version to 1.0.10 (details)
246. #1081 Add priority to mappers (details)
247. #586 drop consumed messages in dry run mode, disable auto commit in dry run mode (details)
248. #586 make kafka producer restart backoff configurable (details)
249. #586 fix KafkaPublisherActorTest (details)
250. gracefully shutdown logback-classic logging in DittoService during coordinated shutdown (details)
251. add debug log to postStop method; (details)
252. Adds entity placeholder for http push target path (details)
253. #586 make kafka producer restart backoff configurable, move config for alpakka into separate config inside of consumer and producer, implemented config model for consumer and producer (details)
254. #586 wrap kafka send result in source and use flatmap to fail the source and restart it (details)
255. #586 recreate send producer and source queue when the producer stream is restarted (details)
256. #586 fix config file for tests (details)
257. #586 fix wrong parentheses in connectivity config (details)
258. to rule out runtime classnotfound errors, put janio back to "compile" scope (details)
259. #586 fix more wrong parentheses in connectivity config (details)
260. #1081: remove requirement of passing knowledge about "exists" function in PipelineFunctionFilter (details)
261. log shutdown reason; (details)
262. #1081: add optional parameters 'true' and 'false' to the 'exists' pipeline filter (details)
263. Revert "#1081 add conditioned thing templates list to implicit mapper" (details)
264. return completionStage from AkkaManagement.stop(); (details)
265. [#1078] Documentation: Replace "message name" by "message subject" for consistency. (details)
266. [#1078] date hmac blogpost. (details)
267. #586 use RestartFlow instead of RestartSource to keep the source queue and restart only the publishing flow, fix handling queue offer result (also for amqp publisher) (details)
268. [#1078] Give testTLSConnectionWithoutCertificateCheck more time; remove actor system contamination between tests. (details)
269. stabilize coordinated shutdown hook in BaseClientActor for sending connection announcements: (details)
270. [#1081] minor fixes. (details)
271. [#1081] Make connection context available for message mappers. (details)
272. set allowed clock skew to 10 seconds to tolerate discrepancy when verifying local time against exp and nbf claims in JWT; (details)
273. [#1081] Replace ConnectivityConfigProvider by ConnectionContextProvider. (details)
274. Add setter for multiple subjects at once (details)
275. #586 add test to verify usage of entity:id placeholder in http push target (details)
276. #586 remove some debug statements (details)
277. added slidedeck for Ditto 2.0 release notes + roadmap (details)
278. [#1081] Make ConnectionContextProvider asynchronous. (details)
279. [#1081] Allow customization of expression resolver in ImplicitThingCreationMessageMapper. (details)
280. add new config key 'allowed-clock-skew' to oauth config; (details)
281. add unit test for setSubjects, add @since tag (details)
282. fix todo, remove unused import (details)
283. fix license header (details)
284. configure mongodb circuit breaker timeout higher (details)
285. made it possible to round policy announcements to milli seconds; min granularity is now 1ms; (details)
286. increase connectivity updating-state-timeout from default 5s to 15s (details)
287. added slidedeck for "Ditto in 20 minutes" in scope of upcoming WoT presentation (details)
288. document mapToDittoProtocolMsgWrapper and mapFromDittoProtocolMsgWrapper in connectivity-mapping.md; (details)
289. fix missing source and target parameter for ditto-rql-model; (details)
290. Allow to overcome some restrictions of the service by header: ditto-sudo=true (details)
291. Add tests for ditto-sudo header (details)
292. Add security protocol headers to kafka consumer properties (details)
293. add circuit breaker config to akka-contrib-mongodb-persistence-connection-journal in connectivity.conf; (details)
294. review of documenting javascript wrapper functions: (details)
295. Allow to configure the consumer group ID for a kafka connection (details)
296. Add documentation for the new specific config of a kafka connection (details)
297. added logging for publishing StreamingSession signals (WS/SSE) (details)
298. [#1081] Fix client actors not reacting to connectivity config updates. (details)
299. [#1081] update connection config in connection persistence actor. (details)
300. [#1081] make query parser asynchronous. (details)
301. [#1081]: add unit test for DittoConnectionContext (details)
302. [#1081] Add fail safe for connectivity config change registration. (details)
303. fixed DittoRuntimeException calculation from Throwable at various places (details)
304. [#1081] Make Ditto headers serializable & add them as an extra parameter for client actors. (details)
305. fix several issues with publishing messages to kafka (details)
306. temporary ignore failing unit tests (details)
307. fixed NPE in ThingPredicatePredicateVisitor when in fact "@Nullable" object to compare with was null (details)
308. add error message into GatewayInternalErrorException; (details)
309. Fix Kafka consumer and producer config (details)
310. fix KafkaPublisherActorTest (details)
311. remove test nonRetriableExceptionBecomesClientErrorAcknowledgement, it verified removed behavior (details)
312. FIX: kafka producer parallelism wasn't used (details)
313. [#1081]: add clarifying comment why deleteStrategy is get during runtime (details)
314. Try to avoid to wait for completion of each sending future before sending the next (details)
315. temporary ignore unit test (details)
316. fix unit test (details)
317. bump qpid-jms-client version to 1.0.0; (details)
318. [#1081] Remove blocking wait in JWT authentication. (details)
319. fixed that signal enrichment errors were not handled correctly as they were wrapped in (details)
320. removed max-bulk-size from UpdaterConfig; (details)
321. removed test for max-bulk-size from DefaultUpdaterConfigTest; (details)
322. add missing @since to isSudo method (details)
323. updated Eclipse jarsigner signing URL (details)
324. updated eclipse jarsigner version to latest 1.3.1 (details)
325. add more check methods to ScopedConfig which check the values read from the config file and throws DittoConfigError when the value is not in the expected range; (details)
326. rename methods and fix result check; (details)
327. adapt snapshot-test.conf to fix DefaultSnapshotConfigTest; (details)
328. fix DefaultSnapshotConfigTest; (details)
329. allow EVENT_LOOP_THREADS to be 0; (details)
330. relaxed some checks for reading config values; (details)
331. add implicitStandanloneThingCreation mapper description (details)
332. update link to Eclipse Vorto (details)
333. [#1081] relax filter condition for mappers. (details)
334. fixed getting workers config in DefaultTunnelConfig (workers can be 0); (details)
335. [#1081]: add examples for the new exists filter for placeholders (details)
336. switch to getNonNegativeDurationOrThrow for writeInterval in DefaultStreamConfig; (details)
337. Add timer for adding a connection log entry (details)
338. [#1107] add requested-acks to subject announcements. (details)
339. threshold for Snapshot only have to be positive; (details)
340. fix evicting queue growing unbounded under high load (details)
341. change instantiation of DefaultPersistenceCleanupConfig when updating; (details)
342. fix consumed messages counted twice for kafka (details)
343. [#1081] fix copyright year (details)
344. Resolve connection id placeholder for group ID in specific config (details)
345. update Netty to 4.1.65.Final (details)
346. handle errors on stream completion in kafka consumer (details)
347. enable connection-checker for kafka consumer (details)
348. optimize imports (details)
349. #558 provide some basic Grafana dashboards as starting point in monitoring Eclipse Ditto (details)
350. fixed missing OSGi import of "org.atteo.classindex" in ditto-base-model (details)
351. [#1107] Add SubjectExpiryActor. (details)
352. fix connection-checker enablement (details)
353. review: made some configs "non 0"-able where reasonable (details)
354. configure max restarts for kafka publisher (details)
355. [#1107] Add PolicyAnnouncementManager. (details)
356. remove with consumer factory (details)
357. [#1107] rename SubjectAnnouncement field requestedAcks/beforeExpiry to requestedAcks/labels. (details)
358. Add two metrics in ditto publish and subscriber to make sure that the messages are los by akka remoting (details)
359. handle stream completion if consumer fails and escalate exception to client actor (details)
360. [#1107] Stabilize PolicyPersistenceActorTest. (details)
361. add new dependency commons-net to bom.xml; (details)
362. remove TagsConfig and all dependent implementations and configs because streamingCacheSize it is no longer used; (details)
363. renamed metric for actually sent messages in publisher (details)
364. add blocked-host-regex to connectivity.conf; (details)
365. fix NPE in HostValidatorTest; (details)
366. implement consumer offset reset within specific config of kafka connections (details)
367. [#1107] Start AcknowledgementForwarder for policy announcements. (details)
368. update SSHD version to 2.7.0 (details)
369. undo updating sshd to 2.7.0 (breaking API changes in the version) (details)
370. Only fail validation if a value for consumer offset is configured (details)
371. use drainAndShutdown to gracefully shutdown the connection an minize loss of messages (details)
372. [#1107] Document qos-1 announcements. (details)
373. Introduce AskWithRetry "pattern" for async concierge cache loading (details)
374. [#1107] Add PolicyAnnouncementConfig. (details)
375. Added unit tests for AskWithRetry (details)
376. make unit test more stable (details)
377. make unit test more stable (details)
378. fixed non-0-able "limit" in DefaultThrottlingConfig (details)
379. moved AskException to ditto-base-model as the exception must be available everywhere (e.g. gateway/connectivity) (details)
380. Fix reconnect loop due to separate MQTT publisher client. (details)
381. Fix that QoS in target has no effect for MQTT. (details)
382. Fix ActorInitializationException in AmqpConsumerActor. (details)
383. MQTT: Do not suppress reconnection for redelivery. (details)
384. Test MQTT QoS from target. (details)
385. Fix spurious ConnectionNotAccessibleException during TestConnection; stabilize DefaultEvictingQueue. (details)
386. Fix logging in kafka message transformer (details)
387. bump netty-bom version to 4.1.66.Final; (details)
388. emit ConnectionDeleted event in ConnectionPersistenceActor; (details)
389. Make InboundMappingProcessorActor a streaming component (details)
390. [#1107] fixed review findings: (details)
391. [#1107] extracted constants in test (details)
392. Move mutable state handling into akkas hands (details)
393. removed empty enum from CachesConfig; (details)
394. fixed compile error in DefaultCachesConfig; (details)
395. fixed some broken links in docu; (details)
396. [#1107] review: enhanced documentation with: (details)
397. [#1107] fix documentation review findings (details)
398. extract kafka topic, key and timestamp from a received record and add them to the headers to make them available in payload and header mappings, implemented AbstractConsumerActorTest for Kafka, extracted source supplier from KafkaConsumerActor for better testability (details)
399. document special kafka headers (details)
400. Fix that configured persistence parallelism had no effect on search updater throughput. (details)
401. add since annotation to new methods in GenericTarget; (details)
402. increase added seconds to invalid nbf token to stabilize tests (details)
403. Model InboundDispatchingActor as Sink (details)
404. fixed HostValidationResult duplicated error message (details)
405. review: log IllegalArgumentException with stacktrace for subnet detection (details)
406. Allow to throttle the inbound stream after payload mapping (details)
407. increase added seconds to invalid nbf token to stabilize tests (details)
408. [#1107] Make exponential backoff of policy announcements configurable. (details)
409. update version of apache mina sshd to 2.7.0 (details)
410. swtich to actions/setup-java@v2 (details)
411. adjust logging of "Zombie" messages to DEBUG (details)
412. fix AbstractSSLContextTest for JDK >= 11.0.12 (details)
413. add hint on expiry and announcement options (details)
414. build GH actions with "zulu" JDK (details)
415. Use MergeHub to inject messages into a sink that is materialized at (details)
416. fix license header issues (details)
417. Validate path of a live message in protocol adapter (details)
418. review: added/fixed javadoc (details)
419. fix conversion of ThingMerged events to a Thing (details)
420. fixed that cleanup shortcut added in AbstractPersistentActorWithTimersAndCleanup did not send a success (details)
421. Reuse success response handling (details)
422. Reduce unnecessary error logs. (details)
423. Log entire response on debug level. (details)
424. Log HTTP request for setting responseLocationUri. (details)
425. review: undid turning off JMS FailoverProvider logger (details)
426. Add new value "MISCONFIGURED" for ConnectivityStatus enum (details)
427. add missing since tag to new enum value (details)
428. Add javadoc to ConnectivityStatus#isFailure (details)
429. Show misconfigured live status if any client has misconfigured state (details)
430. adjusted RetrieveConnectionStatusAggregatorActor to also include sourceStatus, targetStatus and sshTunnelStatus in the combined calculated "liveStatus" of a connection (details)
431. with each "PingCommand", determine the live ConnectionStatus and log it to ERROR/WARN/INFO log depending on the overall live status (details)
432. Allow to define user indicated errors which can be resolved to a (details)
433. fix unit test (details)
434. speed up validation of message path (details)
435. Do not publish SubjectDeletedAnnouncement for updated subjects. (details)
436. #1135 implement basic tracing (using w3c trace context and kamon-opentelemetry), add dependency to kamon-opentelemetry, extend existing DittoMetrics timer to also create a trace, add rudimentary tracing (at least one trace per service) and read/propagate trace context at the edges (gateway/connectivity) (details)
437. #1135 document tracing configuration (details)
438. Add feature toggle for when-deleted subject announcements. (details)
439. fix bug in message path validation and add tests (details)
440. Resolve connectivity status from given exception for all client actors (details)
441. Remove TimeMeasuringFlow. (details)
442. added new MDC key "ditto-log-tag" used in Connection live status logs + switched misconfiguration to "warning" level (details)
443. #1135 make activiation of tracing configurable (generation of trace spans/context propagation) (details)
444. added "connection-id" MDC entry which got lost otherwise (details)
445. #1135 move tracing out of the metrics timer and provide a DittoTracing.wrapTimer instead (details)
446. review: made ImmutableConnectionFailurand ImmutableClientDisconnected package private, pulled static creators to interfaces (details)
447. review: added ConnectivityStatusResolver to BaseConsumerActor in order to resolve status in KafkaConsumer (details)
448. Switch to info level for misconfigured connectivity status (details)
449. Set connection status on every failure backoff based on the ConnectionFailure (details)
450. #1135 fix default channel in tracing config, add unit tests for context extraction/propagation (details)
451. handle 'canConnectViaSocket' for reconnect (details)
452. #1135 enclose tests for disabled tracing (details)
453. Treat kafka authenticaiton exceptions as user inidcated errors (details)
454. fixed duplicated throwable.getMessage() "statusDetails" error discription for JMS/AMQP1.0 errors (details)
455. added MQTT exceptions to "user-indicated-errors" (details)
456. added "connection-type" MDC for live-status log statements (details)
457. Allow to enhance the coded config list by specifying environment variables (details)
458. Fix hard-coded headers for HTTP protocol check. (details)
459. Configure exceptions for RabbitMQ that should be treated as user failure (details)
460. treat javax.net.ssl.SSLException as user failure (details)
461. review: added unit test in UserIndicatedErrorsTest testing the environment variable parsing of string objects (details)
462. additionally added configuration overwrites via system properties to make unit test run on Jenkins and via maven as well (details)
463. added timeout behavior to RetrieveConnectionStatusAggregatorActor: (details)
464. added timeouts multiple times if > 1 timeout was encountered; niceified code (details)
465. Categorize ssh tunnel exceptions (details)
466. tracing review: (details)
467. Add OpenAPI documentation about status 424 in messages routes. (details)
468. Add 424 responses to all requests that can request acknowledgements. (details)
469. update docker base image version to newest openj9 version; (details)
470. initial documentation of conditional updates; (details)
471. extend javadoc with ParserException; (details)
472. [#559] add conditionParam.yml and add reference in all thing resources; (details)
473. use ThreadSafeDittoLoggingAdapter in ThingsAggregatorActor; (details)
474. remove dependency to ditto-base-model in ditto-rql-model because it is not used; (details)
475. [#559] add condition header to DittoHeaderDefinition; (details)
476. [#559] fix ImmutableDittoHeadersTest; (details)
477. Test that subjects containing slashes cannot be deserialized as Adaptable. (details)
478. Fix parsing of slashes in topic or path of Ditto protocol messages. (details)
479. Handle topic path starting with "/". (details)
480. [#559] condition can be specified as query parameter and http header; (details)
481. [#559] extend unit test QueryParametersToHeadersMapTest; (details)
482. Reintroduce message path prefix validation for policy and thing message signals. (details)
483. Fix missing "extra" field in DittoProtocolAdapter#fromAdaptable. (details)
484. Add option to delete search entries immediately. (details)
485. Improve resilience of authentication chain. (details)
486. Do not log a stream completion exception as failed message consumption (details)
487. reflect consumer failure in connection status (details)
488. make fileNamePattern configurable via env variable; (details)
489. Add common certificate exceptions (details)
490. Add at least one cause for a failed source to the ConnectionFailedException (details)
491. Add missing mqtt exceptions (details)
492. Improve resilience of DittoRuntimeExceptionToErrorResponseFunction. (details)
493. Add log to analyze reasons of JMS errors (details)
494. Invalid destinations are a user failure (details)
495. [#559] implement conditional requests based on the condition in the ditto headers; (details)
496. Minor code changes during review (details)
497. [#559] fix broken test in ImmutableDittoHeadersTest; (details)
498. [#559] rework implementation of condition checking; (details)
499. [#559] add ThingConditionValidator; (details)
500. Fix enforcement timers not being stopped when filtered in pre-enforcer. (details)
501. Upgrade Akka libraries. (details)
502. Extend signal enrichment facade for search update; fix interpretation of delete events. (details)
503. Use CachingSignalEnrichmentFacade for search index update. (details)
504. Replace unnecessary SudoRetrieveThingResponse in EnforcementFlow; fix ThingUpdaterTest. (details)
505. use same version property for all kamon dependencies (details)
506. add OnStopHandler again as functional interface (details)
507. add tracing for enforcement (timer was removed from AbstractEnforcerActor on master) (details)
508. Enhance piggyback command responses with service and instance info. (details)
509. [#559] remove Condition class because no central validation of the specified condition is possible; (details)
510. [#559] introduce new FieldNamesPredicateVisitor to be able to extract the fieldNames from RQL expression; (details)
511. [#559] check read permission on all resource keys specified in the condition; (details)
512. fix "java.net.ConnectException" entry which contained the message in the exception name instead of the pattern (details)
513. Adjust documentation for piggyback command response format. (details)
514. update akka, scala, slf4j minor dependency versions (details)
515. added info logging for HTTP status code of http-push publishes (details)
516. improved failure logging, only log message on debug level (details)
517. pin used guava version to the one used in kamon-opentelemetry (details)
518. resolve deprecated API usage in HttpPublisherErrorTest (details)
519. Disable Java serialization. (details)
520. minor reformatting and improvements; (details)
521. [#559] add new exception ThingConditionInvalidException and unit test; (details)
522. Implement at-least-once message consumption for kafka (details)
523. [#559] add Ditto blog post for new conditional requests feature; (details)
524. Remove inheritance from Serializable interface. (details)
525. remove unused class (details)
526. add self reference to TaggedMetricInstrument (details)
527. add unit tests for tagging of PreparedTrace and StartedTrace (details)
528. extract adding tags from TaggedMetricInstrument interface, because some implementation might only be able to add tags not retrieve them. use TaggableMetricsInstrument for StartedTrace. (details)
529. add assertion to StartedKamonTraceTest and logback dependency for tests to suppress warnings (details)
530. remove debug logs in stream which were used during development (details)
531. Remove MessageSequentializer as it's not needed (details)
532. Configure parallelism in waiting for commit to max-in-flight (details)
533. explicitly add akka-http as dependency to connectivity-service (details)
534. review: harmonized AMQP 1.0 configuration for consumers/publisher with the Kafka one (details)
535. made DefaultConnectionConfig public again (details)
536. review: (details)
537. fixed unit test (details)
538. update caffeine dependency and fix compile errors (details)
539. Extract real cause out of potential CompletionException (details)
540. Cancel periodic priority update on delete connection (details)
541. Recover before MergeHub to avoid error log (details)
542. replace static scala version in dependency (details)
543. review findings: (details)
544. Add persistence methods to read SN from events and snapshots and delete them. (details)
545. add documentation for Kafka qos 0/1 (details)
546. fixed that connection status of misconfigured connections was changed to "failed" (details)
547. fixed RetrieveConnectionStatusResponse "missingResources" addition to resources arrays (details)
548. fixed ConnectionPersistenceActorTest#recoverOpenConnection (details)
549. empty status arrays shall not be added to resulting Json document at all (details)
550. fixed RetrieveConnectionStatusResponseTest (details)
551. To avoid a timeout in RetrieveConnectionStatusAggregatorActor (details)
552. There is only one publisher actor for all targets (details)
553. Decrease akka-management.version back to 1.0.10 because of (details)
554. Add credit stream for background cleanup. (details)
555. Restructured AtLeastOnceConsumerStream (details)
556. Add PersistenceCleanUpActor. (details)
557. - set target resource status of dynamic targets (target address with placeholders) to UNKNOWN as we do not track those states (details)
558. Make KafkaConsumerStream @Immutable (details)
559. Await stopping of KafkaConsumerStream to a maximum of 10 seconds (details)
560. Instead of restarting the whole KafkaConsumerActor just restart the (details)
561. Rename and test CleanUpConfig; add PersistenceCleanUpActor.props (details)
562. Restart KafkaConsumerStream with exponential backoff (details)
563. backoff after a consumer was closed before recreating the message consumer to better reflect the actual state of the consumer in the source resourse status (details)
564. Count successful and failed acknowledgements in connection metrics (details)
565. add unit test for AmqpConsumerActor backoff and resource status update (details)
566. Avoid couting rejected messages as consume failures (details)
567. Fix and add unit tests (details)
568. Start PersistenceCleanUpActor in Things, Policies, Connectivity. (details)
569. Add counters for events and snapshots deleted in the background. (details)
570. Make deleted snapshots empty. (details)
571. Remove centralized background cleanup. (details)
572. Add live config retrieval and modification for background clean-up. (details)
573. add GH discussions as another feedback channel (details)
574. Reduce code duplication (details)
575. stabilize failure detection of connectivity live status (details)
576. fixed Ditto tracing precision bug regarding use of Instant.now(), use Kamon's clock instead (details)
577. round of HTTP parallelism to next factor of two (details)
578. use .map(DefaultHttpPushFactory::determineNextPowerOfTwo) in DefaultHttpPushFactory (details)
579. Make PoliciesRoute Path public (details)
580. Add SearchUpdateListener to MongoSearchUpdaterFlow (details)
581. Organized some imports and sorted Ditto modules alphabetically. (details)
582. Fixed config for things-search update listener implementation value. (details)
583. Fixed `SearchActorIT`. (details)
584. Use SearchUpdater in mapping stage instead of sink (details)
585. Issue #1093: Introduced `EntityIdInvalidException`. (details)
586. Issue #1093: Made `NamespacedEntityIdInvalidExcaption` a subclass of `EntityIdInvalidException`. (details)
587. Issue #1093: Small improvements. (details)
588. Increased some test time-outs which failed because of actorSystem init (details)
589. Add JsonParsable und fromJson to EntityIdForTestsInvalidException for error registry tests (details)
590. test UserIndicatedErrors matching with "cause" being the matching class (details)
591. Fix rebase (details)
592. PersistenceCleanUpActor: Enable setting last-pid in ModifyConfig (details)
593. fixed determination of cluster connectivity instances count (details)
594. review: renamed consumerRestartBackOffConfig to restartBackOffConfig (details)
595. Document new background cleanup DevOps API. (details)
596. Fix some code-smells (details)
597. Fix DefaultPersistenceStreamingActorTest. (details)
598. Log non successful status codes as failure for http publishes (details)
599. review: don't assume ConnectivityStatus.FAILED in AmqpPublisherActor when producer is closed (details)
600. fixed mocking in AmqpPublisherActorTest (details)
601. fix AmqpConsumerActorTest (details)
602. fix BaseClientActor backoff behavior: increase state timeout only for the first failure received during backoff (details)
603. enhance the message rejected log with information to identify the message that was rejected (details)
604. added more detailed resource "statusDetails" message for AMQP 1.0 producer closed (details)
605. also test the case when backoff is triggered from CONNECTED state (details)
606. Do not filter null record values (details)
607. Handle expired messages after transformation to ensure they are (details)
608. Document message expiration behavior for kafka (details)
609. fix spelling (details)
610. review: add "failureCount" to backoff/reconnecting logging (details)
611. remove 503 error response for messages from openapi docs (details)
612. review: rename CleanUp, add unit tests for CleanupResult and SnapshotRevision (details)
613. stabilize AmqpConsumerActorTest (details)
614. add JS mapper configuration to allow use of "unsafe" standard objects (useful when debugging) (details)
615. review: rename CleanUp (details)
616. Add visitors to compute the diff of BSON documents. (details)
617. Test incremental update via BsonDiff. (details)
618. Use BsonDocument as the document type for search index update. (details)
619. Introduce incremental update into search updater stream. (details)
620. Add 1% force update probability to ThingUpdater. (details)
621. Add counters for search background sync stream. (details)
622. Search updater: Add shortcut for identical JSON object diff. (details)
623. Fix incremental search update. (details)
624. Search update: improve array diff computation; optimize diff of internal arrays. (details)
625. Fix filter of UpdateOne write model; fix nonnegative hashcode computation. (details)
626. Fix code smells; remove unnecessary cleanup config in Concierge. (details)
627. Fix unit tests. (details)
628. [#1170]: Implement fn:replace (details)
629. Enrich deleted events with last state of twin if signal enrichment is (details)
630. respond with overall live connectionStatus "open" when subresources are in "unknown" state but all clients are "open" (details)
631. update to Netty 4.1.68.Final (details)
632. improve logs in order to find out why some amqp 1.0 connections still "fail" (details)
633. Ensure ConnectionLoggerRegistry and DefaultMuteableConnectionLogger do not throw exceptions (details)
634. update logback to 1.2.6 (details)
635. Add missing periods (details)
636. Remove MongoDB dependencies from Concierge. (details)
637. Split implementation of CacheKey for SignalEnrichment and Enforcement (details)
638. Search updater: fix timer timeout and update error due to empty objects. (details)
639. Search updater: support nested {} as value. (details)
640. Fix double slashes in location header (details)
641. verify successful AmqpConsumerActor startup by checking their resource status after starting them (details)
642. review for deleted event enrichment: (details)
643. Fix IllegalArgumentException due to empty updates. (details)
644. fix NPE in unit test and verify resource status is correct after consumer actor failure (details)
645. A correlation ID shout not be part of the cache key (details)
646. Add correlation ID to headers if not present (details)
647. RetrieveThing and SudoRetrieveThing cannot be applied when thing is null (details)
648. allow overwriting the Contextual.askWithRetryConfig (details)
649. Use UnaryOperator instead of function (details)
650. review: adjusted config environment keys to include "AMQP10_" prefix (details)
651. UriForLocationHeaderSupplier: Test trailing slash. (details)
652. reset session data after failure in base client actor (details)
653. allow to use an URL as "definition" for Thing + Feature definitions in addition to the namespace:name:version (details)
654. Fix updater errors due to string values starting with '$'. (details)
655. increase Mockito.verify() timeout of MockSnapshotStorePlugin to 10s to stabilize CI (details)
656. Apply e2e backpressure by using requested acks (details)
657. Review commit: (details)
658. [#559] - review blog post (details)
659. [#559] - review openapi (details)
660. add "conditional updates" and move "signal enrichment" to "signal types" sub-folder (details)
661. review conditional updates (details)
662. [#559] Add more unit tests to new 'condition' validator (details)
663. [#559] Add unit tests for new field name visitor and little refactoring (details)
664. Issue #559: Renamed local variable to plural. (details)
665. Issue #559: Removed duplicate empty line and throw an AssertionError in constructor of this utility class. (details)
666. [#559] Make ditto headers mandatory for condition failed exception (details)
667. #559 extend QueryParametersToHeadersMapTest and test setting AllowPolicyLockout header via query parameters; (details)
668. #559 extend docu and blog post; (details)
669. remove http request directive from code snippet; (details)
670. #559 include docu review findings; (details)
671. #559 remove condition from message in ThingConditionFailedException; (details)
672. #559 add condition to protocol-envelope.json and protocol-specification.md; (details)
673. #559 extend ExistsFieldExpressionVisitor and FilterFieldExpressionVisitor to use metadata in conditions; (details)
674. #559 remove implementation for visitMetadata in GetExistsBsonVisitor and GetFilterBsonVisitor; (details)
675. #559 return bson filter that don't match for visitMetadata because searching for metadata isn't supported; (details)
676. #559 update date of blog post; (details)
677. remove unused imports; (details)
678. #559 update blog post; (details)
679. #559 use UTC timestamps in blog post example; (details)
680. Remove "deleteAt" from search queries to work around MongoDB issue SERVER-12869. (details)
681. Add documentation for backpressure of kafka consumers based on requested-acks (details)
682. added empty lines around code block (details)
683. added release notes for Ditto 2.1.0 (details)
684. update Kafka client to 2.8.1 (details)
685. enhanced Ditto 2.1.0 release notes to final state (details)
686. added Ditto 2.1.0 announcement blogpost (details)

prepared Ditto 2.0.0 release notes + announcement blogpost

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

Open and create connection with automated logging activation

Signed-off-by: Vadim Guenther <vadim.guenther@bosch.io>

Fix test when open connection with automated logging activation

Signed-off-by: Vadim Guenther <vadim.guenther@bosch.io>

Mention that connection logging is enabled when opening or creating connection

Signed-off-by: Vadim Guenther <vadim.guenther@bosch.io>

Fix test for logging enabling

Signed-off-by: Vadim Guenther <vadim.guenther@bosch.io>

Issue #1043: Moved `EmptyTopicPath` from `ImmutableTopicPathBuilder` to package level. Added a unit test.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

updated release notes with the current module/package structure
* added feature JWT auth via WebSocket query param to changelog
* switched SandboxingContextFactory to measure time with System.getNanos() to improve precision

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

documented removal of "x-ditto-dummy-auth" header

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

updated renamed modules/packages
* moved release date to 04.05.2021

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

Issue #1043: Reduced too high amount of constructor arguments of `ImmutableTopicPath`.
* `ImmutableTopicPathBuilder` is now a private nested class of `ImmutableTopicPath` to be able to refer to to its instance field in constructor.
* An instance of `ImmutableTopicPath` can now only be obtained via builder. Thus removed static factory methods.
* Moved parsing of TopicPath string representation from `ProtocolFactory` to `ImmutableTopicPath` to make use of the nested builder.
* Reworked parsing of `TopicPath` from string to provide meaningful context in case of errors.
* Adjusted some Javadoc comments to reflect the code.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

Issue #1043: Added methods for easier evaluation of `TopicPath`.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

Issue #1043: Replaced equality checks with call to `is...` methods of `TopicPath`.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

Issue #1043: Fixed result creation of `ImmutableTopicPath#getPath()` and added a unit test that covers an empty namespace part.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

update maven packages names in maven structure overview;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

improve release announcement and release notes;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

fiy typo;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

Issue #1043: Set '@since' version to 2.0.0.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

Issue #1043: Removed empty topic path and its usage. Ditto Protocol messages are always required to have a topic. Thus an empty topic path implementation did not make sense.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

Issue #1043: Added missing 'package-info' files to packages to add `@Nullable` annotations.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

Issue #1043: Fixed Javadoc comment.
`HeaderTranslator#fromExternalHeaders(Map)` might return an unmodifiable Map.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

Add connectivity announcements for when a connection was opened or closed

Signed-off-by: Florian Fendt <Florian.Fendt@bosch.io>

Issue #1043: Refactored `AbstractAdapter`.
* Removed unused methods.
* Re-ordered methods according to the Stepdown Rule.
* Moved method `getEventTopicPathBuilderFor` to `AbstractThingAdapter` as it is only used by sub-classes thereof.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

fixed GitHub actions (dockerfiles were moved)
* adjusted JMH -benchmark.jar generation to be in a separate profile or policies-model and connectivity-service (JavaScript benchmark)

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

Issue #1043: Re-added missing 'package-info' files to packages to add `@Nullable` annotations.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

Issue #1043: Fixed compilation errors after merging master branch.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

added ditto-things-model and ditto-policies-model as explicit dependencies to ditto-protocol

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

Issue #1043: Fixed invalid reference in Javadoc.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

changed scope to compile for ditto-internal-utils-persistence

in ditto-base-service

temporary ignore TimeMeasuringFlowTests

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

Issue 1043 fix minor misspelling as part of review

Signed-off-by: David Schwilk <david.schwilk@bosch.io>

Add connectivity announcements to the ditto protocol

Signed-off-by: Florian Fendt <Florian.Fendt@bosch.io>

added "akka-discovery-kubernetes-api" and "akka-lease-kubernetes" dependencies to ditto-base-service so that all services depend on it
* made EmptyEvent not require the added "eventType" JSON field in order to not break old events

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

stabilize PolicyPersistenceActorTest by waiting for at least once for deletion announcement

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

stabilize ConnectionPersistenceActorTest EnableConnectionLogs related test instabilities

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

Also resolve connectivity signals from Adaptables

Signed-off-by: Florian Fendt <Florian.Fendt@bosch.io>

stabilize ConnectionPersistenceActorTest EnableConnectionLogs related test instabilities, part 2

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

Add connection announcements to the Topic

Signed-off-by: Florian Fendt <Florian.Fendt@bosch.io>

made EmptyEvent no longer implement WithEntityId

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

stabilize ConnectionPersistenceActorTest EnableConnectionLogs related test instabilities, part 3

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

Add connection announcements to the signal filter

Signed-off-by: Florian Fendt <Florian.Fendt@bosch.io>

fix MQTT publisher warnings when no MQTT consumer was present
in combination with when "separatePublisherClient=true":
* create a dummy MQTT subscription handler in such cases which does not actually subscribe

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

Don't subscribe to internal Ditto PubSub for connectivity announcements as they are only sent outwards

Signed-off-by: Florian Fendt <Florian.Fendt@bosch.io>

redact sensitive parameter/header values before logging

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

fixed some sonar issues and typos;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

don't calculate filteredRawRequestUri if debug logging was not activated

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

updated date of release 2.0 in docs

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

fixed javadoc errors discovered in release build

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

added Ditto 2.0 to documentation version picker

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

activate binary compatibility check to version 2.0.0

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

added Ditto 2.0.x to SECURITY.md

restructure kubernetes deployment Readmes;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

bump nginx version to 1.20-alpine;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

#1052: Fix typo

Signed-off-by: Vadim Guenther <vadim.guenther@bosch.io>

Send connection announcement after opening and before closing a connection

Signed-off-by: Florian Fendt <Florian.Fendt@bosch.io>

Close connections when shutting down the the cluster (which will trigger sending a close announcement)

Signed-off-by: Florian Fendt <Florian.Fendt@bosch.io>

Close connection before deleting it (which will automatically send a connection announcement)

Signed-off-by: Florian Fendt <Florian.Fendt@bosch.io>

fix ErrorHandlingActorTest

Signed-off-by: Florian Fendt <Florian.Fendt@bosch.io>

Avoids throwing exceptions in ditto metrics and return more or less
reasonable return values in combination with a WARN log instead

* The reason for this is that we don't want productive code to break
  because of errors in metrics

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

fixed typo in 2.0 announcement

only log warning if already stopped timer should be stopped

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

fixed parallelism of search-updater using "flatMapMerge"
* added async() boundary which was missing and caused parallelism to not have an effect
* additionally made it possible to configure a minPoolSize for MongoDB connections

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

added custom dispatchers for flatMapMerge() with async() usage in
* connectivity
* things-search

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

fixed EnforcementFlowTest

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

added missing dispatcher to search test config

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

fixed SearchActorIT

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

fixed that Policy Error responses in WS contained wrong topic path
namespace and name were not correctly separated

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

#1052: validate that connection announcements can only be used with client count 1

Signed-off-by: Florian Fendt <Florian.Fendt@bosch.io>

fixed default config of retrieval.parallelism to be a factor of 2

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

removed .withAttributes(Attributes.inputBuffer from search-updater-flows

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

uncomment resources config for all services;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

#1052: Add documentation for connection announcement

Signed-off-by: Vadim Guenther <vadim.guenther@bosch.io>

#1052: mention connection announcements in protocol-specification.md

Signed-off-by: Vadim Guenther <vadim.guenther@bosch.io>

relax mqtt validation for source header mappings

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

Fixed missing publish metrics for published messages without
issued/requested acknowledgements

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

1052: fix wording for connection announcement

Signed-off-by: Vadim Guenther <vadim.guenther@bosch.io>

fixed that for commands requesting "search-persisted" the wrong write concern was used
* collections were mixed up
* also fixed some logging in connectivity which missed the correlation-id

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

added "docker pulls" badge to readme

Issue #1060: add test cases for Azure and AWS signing processes

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

made AckUpdater work with ddata sharding
having a shard count > 1
* added a unit test testing with 2 systems and remote declared acks

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

Issue #1060: add azure monitor request signing

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

Issue #1060: Add AwsRequestSigning; switch signing timestamp formatter to DateTimeFormatter; add TODO in AbstractBaseClientActorTest

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

Issue #1060: Add HmacCredentials.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

Fix broken links in installation-operating.md

Implement basic structure for kafka consumers

* All TODOs are prefixed with 'TODO: kafka source'

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

added logging a type hint to AbstractEnforcement successful enforcement
* fixed toString() in Contextual

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

put log statements with debug content to DEBUG level

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

Added validation for source address and target header mappings

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

Issue #1060: add dynamic loading of HTTP request signing algorithms.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

review: fixed comment which still pointed to outdated enum name

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

Handle exceptions in MessageProcessor to avoid exceptions in KafkaStreams

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

Make move the logic again to a transformer

* I noticed that the processor I used seems to be deprecated and even worse
  the pattern I used to split the stream for exceptions and messages
  was bad practice.
* Adds unit tests for the transformer

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

use var keyword;
fix typos;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

Use correct branch names to access them in the map

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

use min interval from backoffConfig to create RestartSettings;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

Issue #1060: Only validate certificate for client certificate credentials in the absence of server certificate; do not throw UnsupportedOperationsException in other cases.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

move start of stream to preStart hook

Signed-off-by: Johannes Schneider <johannes.schneider@bosch.io>

move initialisation of logger back to top

Signed-off-by: Johannes Schneider <johannes.schneider@bosch.io>

Use scalas Either to avoid using generic Object as return type

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

WIP: switch to akka-stream-kafka

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

fix MQTT protocol level acknowledgements
* when "reconnectForRedelivery=false", sucessful MQTT ACKs are issued even when a redelivery of the message is expected -> changed that behavior to only ACK when no redelivery is expected
* made "cleanSession" config not to be based on "reconnectForRedelivery" value - apply a default of "false", but make the default configurable in connectivity.conf
* added a new "event-loop-threads" option configuring the used HiveMQTT client to use a fixed amount of netty event-loop threads instead of having them dynamically calculcated by default based on the processor count
* adjusted MQTT docs

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

fixed applying "eventLoopThreads" option
* always use timer in order to schedule redelivery of unacked messages when using "reconnectForRedelivery"
* undid not sending back "acknowledgement" when not using "reconnectForRedelivery" as MQTT brokers would not re-deliver the message anyway
* added documentation for configuring "acknowledgementRequests" for MQTT sources in order to handle QoS 0/1/2 correctly

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

#1052: edit documentation for topic path of connection announcements

Signed-off-by: Vadim Guenther <vadim.guenther@bosch.io>

applied manual reconnect for MQTT connections
* triggering a reconnect based on the situation, e.g. for reconenct because of redelivery, directly reconnect without any delay
* don't setup new hivemq clients for the manual reconnect, but rather reconnect the existing ones
* applied some simplifications caused by this new approach

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

make it possible to write logs to Logstash endpoint;
add possibility to disable sysout logs;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

add logstash-logback-encoder and janino dependency;
add RollingFileAppender to logback.xml;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

add exclude for shade plugin;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

add volume and volumeMounts to access ditto log files;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

#1052 correct year in licence header

Signed-off-by: Vadim Guenther <vadim.guenther@bosch.io>

removed duplicate check for empty failed responses;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

add missing volumeMounts;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

add logging possibilities to installation-operating.md;
make maxHistory and totalSizeCap configurable via env vars;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

review: prefixed all logging related environment variables with `DITTO_LOGGING_`

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

fixed logback XML error

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

added Ditto 2.0.1 release notes

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

Issue #1060: Support GET method in HTTP connections; support x-amz-content-sha256 in AwsRequestSigning.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

added a new introduction slide-deck for Eclipse Ditto

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

Issue #1060: Fix xAmzContentSha256 field name; log outgoing HTTP request on DEBUG.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

Remove not needed hyphen in ditto-cluster.yaml

Surround env value with double quotation marks

Fix command to start ditto with another version

Issue #1060: Log signed requests on DEBUG level.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

Connectivity: Improve debug log for incoming messages.

- Log actor ref of response collector for message correlation.

- Add toString() method to MappingOutcome.

- Fix an IndexOutOfBoundException in BaseConsumerActor logging.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>