Changes

Summary

1. #898: restructured DittoProtocolAdapter to be able to determine the TopicPath for a given Signal (details)
2. #898: moved ditto-internal-models-placeholders to a public module "ditto-placeholders" (details)
3. #898: made "ditto-placeholders" a valid OSGi module (details)
4. prolonged RedHat's copyright year to 2021 (details)
5. #898: fixed Java 11 usage when ditto-placeholders now must be Java 8 compatible (details)
6. #898: fixed broken search for top-level thing "definition" (details)
7. #898: enhanced SignalFilterTest unit test by testing with "topic:action" for modified events and "topic:subject" for filtering live messages (details)
8. Increase default outbound message queue size to 1000 (details)
9. Introduce source queue for MqttPublisherActors (details)
10. NamespacedEntityIds cannot identify a connection (details)
11. Extract inner class to super class as cohesion is very low (details)
12. add optional MetricsAlert to SlidingWindowCounter that triggers a given action in case a given condition is met, implement ThrottledMetricsAlert that detect if a metric has reached a given threshold, use the ThrottledMetricsAlert to monitor the consumed inbound counters and record threshold exceedance in the new THROTTLED metrics counter, fix DefaultConnectionThrottling config loading the corrct values from the given config (details)
13. add throttling detection tolerance to configuration, some javadoc and cleanup (details)
14. use last timestamp to determine the value of throttled metric for 1min measurement window (allowes more accuracy) (details)
15. added Ditto 2.1.0 announcement blogpost (details)
16. update supported versions security-wise (details)
17. make readConcern and readPreference to use for MongoThingsSearchUpdaterPersistence configurable (details)
18. configured "binary-compatibility-check.version" version to 2.1.0 (details)
19. added Ditto logo / artwork (details)
20. adjusted @since javadoc to 2.2.0 (details)
21. handle modifications to throttling config for kafka sources by adapting the costs per message dependent on the configured limit per interval (details)
22. update throttling alerts on modification of throttling config (details)
23. fixed drop behavior of mapping queue in LegacyBaseConsumerActor (details)
24. use classloader of EntityId to find annotated classes (details)
25. Revert "use classloader of EntityId to find annotated classes" (details)
26. provide blog post with overview of new kafka consumer feature (details)
27. Adjust date of blog post (details)
28. Kafka blogpost review: applied some formatting, fixes of dead links (details)
29. added topnav_title to blogposts (details)
30. add method to get a list of unrestricted authorization subjects to enforcers and use it in concierge to calculate read-subjects (details)
31. fixed that in Thing3ValudePredicateVisitor the "isUnknownField" did not categorize "extra" fields being in "unknownFields" starting with the actual fieldExpression to check, e.g. "/attributes" might be enriched, then "/attributes/foo" must be categorized as "unknown" field and be not filtered prior to enrichment (details)
32. added new ResourcePlaceholder providing "resource:type" and "resource:path" (details)
33. use more common max-queue-size as config key for outbound mqtt queue size (details)
34. set next ditto version for @since (details)
35. #898: added documentation for filtering events+messages using RQL property "topic:" and "resource:" (details)
36. Fix that subject deletion announcement was not published when 2 subjects of the same ID were deleted. (details)
37. Fix timing issue in PolicyAnnouncementManagerTest. (details)
38. improved DittoPublicKeyProvider exception handling + logging on cache loading the JWT public key (details)
39. Minor review changes (details)
40. #898: don't format placeholders for RQL expressions in documentation with "{{ }}", but plain (details)
41. fixed license header year (details)
42. small improvements to ditto documentation (details)
43. Remove ConnectionContext (details)
44. Stop the kafka consumer actor after stopping the consumer stream (details)
45. Remove unused DittoHeaders from ConnectionConfigProvider (details)
46. fix javadoc (details)
47. increase size of ack labels according to size increase of connection IDs (details)
48. stabilize connection live status for amqp 1.0 connections (details)
49. - Do not block in preStart method of ConnectionSupervisorActor. Instead use message to signal when initialization (retrieval of config) is done. (details)
50. Fix status 500 when sorting a field containing non-primitive values. (details)
51. enable loading additional extra JavaScript libraries which can be used in Ditto's JS based payload mapping (details)
52. fix toString() of Whoami + debug loggin in AbstractHttpRequestActor (details)
53. Review: Delay AMQP consumer status retrieval. (details)
54. Bring back mergeHub (details)
55. Refactor AtMostOnceConsumerStream to not materialize 1 external message sink per message. (details)
56. Fix AtMostOnceConsumerStreamTest and adapt AtLeastOnceConsumerStream (details)
57. Remove recoverWithRetries steps because they were only needed for MergeHub (details)
58. Revert changes in kafka consumer streams back to use flatMapConcat (details)
59. Polished the Ditto project landingpage (details)
60. fixed formatting of JSON examples (details)
61. explicitly configure MongoDB query batchSize same as the limit (details)
62. Count only successfully mapped outcomes into throttling (details)
63. added slides for EclipseCon 2021 IoT community day (details)
64. fixed a bug where an additional source status is shown when a mqtt source has two or more addresses; (details)
65. Fix timeout of acknowledgement aggregator (details)
66. simplify construction of sinks in kafka consumer streams (details)
67. publish connection logs via fluency library to fluentd/fluentbit (details)
68. align sourceStatus presentation for status "unknown/failure/misconfiguration" with status open for mqtt connection; (details)
69. add prefab values to testEqualsAndHashcode for ConnectionLoggerRegistryTest and DefaultConnectionMonitorRegistryTest; (details)
70. Throttle kafka consumer stream also after consuming a record from Kafka (throttling after payload mapping has already been implemented). This early throttling avoids being overloaded with malformed messages and processing them at full speed. (details)
71. add java doc to newPublishingLogger; (details)
72. Refactor CachingSignalEnrichmentFacade (details)
73. Load CachingSignalEnrichmentFacade via Akka Extension (details)
74. Remove unnecessary javadoc from DittoCachingSignalEnrichmentFacade (details)
75. Add caching signal enrichment provider to configs (details)
76. Allow background sync stream to determine whether to invalidate cached things or policies. (details)
77. Add actorSystem to SignalEnrichmentProvider (details)
78. Fix unit tests. (details)
79. Optimize ThingEvent/ Signal casting in DittoCachingSignalEnrichmentFacade (details)
80. Extract search MongoDB clients in an extension; extend ShutdownBehavior to accept namespaces. (details)
81. Fix javadoc. (details)
82. Seperate shard region and proxy creation methods in ShardRegionFactory; add entity ID parameter to ShutdownBehaviuor. (details)
83. Little change (details)
84. Resolve merge conflicts (details)
85. Make review changes (details)
86. Reduce code duplication; remove completed TODO. (details)
87. Enable aknowledgement handling for UpdateThing. (details)
88. Add min-acceptable-seq-number to retrievePartialThing. (details)
89. Add field selectors to SudoSignalEnrichmentFacade. (details)
90. Handle empty updates. (details)
91. Fix toString for AbstractWriteModel implementations (details)
92. Minor review changes (details)
93. Make SearchUpdateMapper asynchronous. (details)
94. Add possibility to send weak acks to metadata (details)
95. Rename sendWack to sendWeakAck (details)
96. Search update: send weak acknowledgements for empty diffs. (details)
97. Search updater: move incremental update computation to SearchUpdateMapper. (details)
98. BsonDiff: extract SET annd UNSET operators as static constants. (details)
99. Extract and document "toIncrementalMongo" methods. (details)
100. Remove empty update test in BsonDiffVisitorIT. (details)
101. BackgroundSyncActor: request ack to discover failed and skipped updates. (details)
102. ThingUpdater: make incremental updates also work for background sync. (details)
103. Fix invalid empty list result in DittoCachingSignalEnrichmentFacade; remove some redundant warning logs (details)
104. Minor review changes (details)
105. Add debug log of all executed write models in MongoSearchUpdaterFlow. (details)
106. Reduce the log level for empty updates from WARN to DEBUG. (details)
107. Unify search updater stream to maintain diff consistency. (details)
108. Recover last write model when starting a ThingUpdater. (details)
109. Set default force update probability to 0. (details)
110. Fix rebasing (details)
111. added configuration classes for configuring all settings of Fluency library (details)
112. fixed wrong date in presentations.md (details)
113. Adjust license header (details)
114. add library default for some fluency variables to connectivity.conf; (details)
115. inject custom "log-tag" + "additional-log-context" to published logs via Ditto configuration (details)
116. fixed equals/hashCode of ConnectionLoggerRegistry (details)
117. allow method DELETE in HTTP push targets (details)
118. make logLevels to publish configurable via Ditto config (details)
119. Add ClientCredentialsFlow for HTTP connections and test happy paths. (details)
120. Fix ConnectivityServiceGlobalErrorRegistryTest. (details)
121. Add ClientCredentialsFlow for HTTP connections. Make JwtInvalidException a user-indicated error. (details)
122. add oauth client credentials to connectivity model (details)
123. Switch to request-level API for token acquisition in HTTP connections. (details)
124. added releasenotes for Ditto 2.1.1 (details)
125. improve naming of OauthClientCredentials members, add validation for requested scopes (details)
126. Augment requests with OAuth2 tokens; add togglable validation that the token endpoint protocol is HTTPS. (details)
127. cache jwt validator (details)
128. Use pinned dispatcher for kafka consumer in order to have one thread (details)
129. Tell kafka broker to wait up to 10 seconds before answering (details)
130. keep order of json elements in connection model in set structures (details)
131. flush logs of FluentPublishingConnectionLogger by (details)
132. minor cleanup after JWT caching PR (details)
133. try to stabilize HttpPublisherErrorTest (details)
134. stabilize flaky MQTT tests by using random correlationIds in AbstractMqttClientActorTest#testConsumeMultipleSources() (details)
135. ignore failing HttpPublisherErrorTest (details)
136. Review: code formatting (details)
137. fix compile error; (details)
138. fix caching of removed thing fields when modifying a complete thing, e.g. removing an existing definition (details)
139. fixed adding missing "_created" field for ThingCreated events (details)
140. updated to Akka HTTP 10.2.7 due to critical reported CVE (details)
141. undid special ThingDeleted handling again as not required for bugfix (details)
142. Fix ConnnectionValidatorTest. (details)
143. remove json array merging functionality from JsonObjectMerger; (details)
144. make waitUntilAllBufferFlushedDurationOnClose configurable (details)
145. reduce warn log to info for messages received during startup of persistenceactors (details)
146. Review: ensure duration is non-negative and not zero when reading the config value; (details)
147. Review: Fix license header; stabilize unit tests. (details)
148. allow to skip waiting for buffer flushing when waitUntilAllBufferFlushed is 0 or negative; (details)
149. Add KafkaConsumerMetricRegistry for collecting kafka consumer metrics (details)
150. Document OAuth2 client credentials flow for HTTP connections. (details)
151. added documentation for "connection log publishing" feature (details)
152. stabilized AmqpClientActorTest.testSetMessageListenerOnConsumerFails (details)
153. omit request body for GET and DELETE requests made via http push connection, add configuration option and allow override via specific config (details)
154. Fix DefaultHttpPushConfigTest. (details)
155. review: remove redundant values from connection json to improve readability (details)
156. fixed typos in docu; (details)
157. added @Nullable annotation to SignalEnrichmentFacade.retrievePartialThing for JsonFieldSelector (details)
158. Add Kamon orchestration for Kafka consumer metrics. (details)
159. apply host validation to configured token oauth token endpoint (details)
160. Add LazyZip to ensure HTTP connections request token at the time of signal publication. (details)
161. Adjust kafka consumer metric naming (details)
162. Fix LazyZipTest. (details)
163. Fix concurrency issues in KafkaConsumerMetricsRegistry (details)
164. Correct dependency mgmt. for kamon akka (details)
165. Fix diff computation on nested arrays. (details)
166. don't add "<not-provided>" correlation-id to published logs (details)
167. don't add "<not-provided>" correlation-id to published logs, fixed also for debug log (details)
168. improve connection log texts, e.g. remove dots at the end (details)
169. fixed SendingTest (details)
170. modified default success/failure/exception message to include the log type in order to e.g. not have "Message processed" message for each log type (details)
171. Test OAuth endpoint when testing an HTTP connection. (details)
172. Fix assertion in HttpPublisherActorTest#testOmitRequestBody. (details)
173. Reduce defaut fetch.max.wait.ms for kafka consumers to 5 seconds (details)
174. Remove unused dependency (details)
175. Review changes (details)
176. Use consumerId also for deregistering from kafka consumer metrics (details)
177. De-Register automatically after the consumerControl has completed either successfully or execptionally (details)
178. Move KafkaConsumerMetricsRegistry registering to extra method (details)
179. enforce connectionId type for parameters (details)
180. Remove ConsumerMetricsRegistry and schedule reporting in consumer actor instead (details)
181. Enforce stronger type for source suppliers in consumer streams (details)
182. remove unnecessary blank lines (details)
183. Remove unnecessary config (details)
184. Enforce stronger type for sinks in ConsumerStream constructors (details)
185. added Ditto 2.1.2 release notes (details)
186. added documentation about the available fields for the "connectivity log publishing" feature (details)
187. use camelCase for tag names (details)
188. add `PATCH` verb to CorsEnablingDirective (details)
189. use latest protobufjs webjar for unit test; don't use minimized version (details)
190. Fix build for MacOS (details)
191. Fix license header year. (details)
192. [#1231]: Allow using the dash a part of the namespace (details)
193. [#1231] adjusted documentation for namespace constraints by supporting the dash as well (details)
194. log headers and payload for mapped signals (details)
195. added namespace scoped loggers for logging details on ThingCommandEnforcement command forwarding (details)
196. Allow to configure connection.max.idle.ms via environment variable (details)
197. added release notes and post-release steps for Ditto 2.2.0 release (details)

#898: restructured DittoProtocolAdapter to be able to determine the TopicPath for a given Signal
* move "instanceof" cascade to DefaultAdapterResolver to make it reusable
* simplified DittoProtocolAdapter, removed non-needed overloaded methods
* added SignalMapper implementations for ThingEvents and extracted the payload adding behavior for events to them
* added SearchErrorResponseAdapter

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

#898: moved ditto-internal-models-placeholders to a public module "ditto-placeholders"
* make use of PlaceholderResolver in RQL ThingPredicateVisitor et. al
* move TopicPathPlaceholder from connectivity internals to "ditto-protocol"
* instantiate TopicPathPlaceholder with extracted TopicPath at places relying on RQL filtering

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

#898: made "ditto-placeholders" a valid OSGi module

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

prolonged RedHat's copyright year to 2021

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

#898: fixed Java 11 usage when ditto-placeholders now must be Java 8 compatible

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

#898: fixed broken search for top-level thing "definition"
* optimized DefaultAdapterResolver to take less "instanceof" checks
* removed static addition for "topic:action" again from ThingsFieldExpressionFactoryImpl, this is not required
* made previously public methods in FieldExpressionUtil package private and exclude from API compatibility breakage

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

#898: enhanced SignalFilterTest unit test by testing with "topic:action" for modified events and "topic:subject" for filtering live messages
* fixed found bug in Thing3ValuePredicateVisitor
* also apply filtering for non ThingEvents (e.g. live messages), but with empty thing

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

Increase default outbound message queue size to 1000

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

Introduce source queue for MqttPublisherActors

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

NamespacedEntityIds cannot identify a connection

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

Extract inner class to super class as cohesion is very low

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

add optional MetricsAlert to SlidingWindowCounter that triggers a given action in case a given condition is met, implement ThrottledMetricsAlert that detect if a metric has reached a given threshold, use the ThrottledMetricsAlert to monitor the consumed inbound counters and record threshold exceedance in the new THROTTLED metrics counter, fix DefaultConnectionThrottling config loading the corrct values from the given config

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

add throttling detection tolerance to configuration, some javadoc and cleanup

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

use last timestamp to determine the value of throttled metric for 1min measurement window (allowes more accuracy)

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

added Ditto 2.1.0 announcement blogpost

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

update supported versions security-wise

make readConcern and readPreference to use for MongoThingsSearchUpdaterPersistence configurable
* in order to have more fine-grained options for those very often executed queries
* defaulting to default mongoDB settings of ditto search

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

configured "binary-compatibility-check.version" version to 2.1.0
* removed existing "<excludes>" from pom files

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

added Ditto logo / artwork

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

adjusted @since javadoc to 2.2.0

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

handle modifications to throttling config for kafka sources by adapting the costs per message dependent on the configured limit per interval

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

update throttling alerts on modification of throttling config

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

fixed drop behavior of mapping queue in LegacyBaseConsumerActor
* when configured with a buffer-size which was reached and backpressure was applied, new elements to the queue were silently dropped
* this dropping is now handled by
** logging an error/warning
** invoking the "reject with retry" mechanism
* pulled up logger construction to LegacyBaseConsumerActor
* increased default mapping buffer size to 500

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

use classloader of EntityId to find annotated classes

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

Revert "use classloader of EntityId to find annotated classes"

This reverts commit 1a165489cd02b0449c985ba845f842f96ab55114.

provide blog post with overview of new kafka consumer feature

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

Adjust date of blog post

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

Kafka blogpost review: applied some formatting, fixes of dead links

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

added topnav_title to blogposts

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

add method to get a list of unrestricted authorization subjects to enforcers and use it in concierge to calculate read-subjects

Signed-off-by: Johannes Schneider <johannes.schneider@bosch.io>

fixed that in Thing3ValudePredicateVisitor the "isUnknownField" did not categorize "extra" fields being in "unknownFields" starting with the actual fieldExpression to check, e.g. "/attributes" might be enriched, then "/attributes/foo" must be categorized as "unknown" field and be not filtered prior to enrichment

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

added new ResourcePlaceholder providing "resource:type" and "resource:path"
* useful in combination with a "topic:" placeholder in order to e.g. only filter for thing "created" events

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

use more common max-queue-size as config key for outbound mqtt queue size

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

set next ditto version for @since

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

#898: added documentation for filtering events+messages using RQL property "topic:" and "resource:"

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

Fix that subject deletion announcement was not published when 2 subjects of the same ID were deleted.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

Fix timing issue in PolicyAnnouncementManagerTest.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

improved DittoPublicKeyProvider exception handling + logging on cache loading the JWT public key

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

Minor review changes

Signed-off-by: David Schwilk <david.schwilk@bosch.io>

#898: don't format placeholders for RQL expressions in documentation with "{{ }}", but plain

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

fixed license header year

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

small improvements to ditto documentation

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

Remove ConnectionContext

* Changes in the connectivity config related to a single connection
  should just restart the connection persistence actor.
  This reduces the complexity of changing config as we can always be sure
  that all components initialized below this persistence actor have the
  up-to-date connectivity config

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

Stop the kafka consumer actor after stopping the consumer stream

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

Remove unused DittoHeaders from ConnectionConfigProvider

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

fix javadoc

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

increase size of ack labels according to size increase of connection IDs

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

stabilize connection live status for amqp 1.0 connections

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

 - Do not block in preStart method of ConnectionSupervisorActor. Instead use message to signal when initialization (retrieval of config) is done.
 - Restart child actor only if modified config is not equal to the previous config.
 - Register for connectivity changes after successful retrieval of config. This also fixes a missing registration if the initial attempt was not successful.

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

Fix status 500 when sorting a field containing non-primitive values.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

enable loading additional extra JavaScript libraries which can be used in Ditto's JS based payload mapping
* Rhino's "CommonJS" loading feature is used, enabling use of `require("module")`
* connectivity service can optionally be configured to load additional JS modules from a file path
* via Docker container volume mount, additional libraries can be provided that way
* no packaging of the JS modules in Ditto is required
* added unit test using protobufjs via "require"

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

fix toString() of Whoami + debug loggin in AbstractHttpRequestActor

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

Review: Delay AMQP consumer status retrieval.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

Bring back mergeHub

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

Refactor AtMostOnceConsumerStream to not materialize 1 external message sink per message.

Signed-off-by: Yufei Cai <yufei.cai@bosch.io>

Fix AtMostOnceConsumerStreamTest and adapt AtLeastOnceConsumerStream
to also work with multiple flows instead of flatMapConcat

* This change is required to increase the performance and make throttling
  in InboundMappingSink effective. With the current approach inboundMappingSink
  would be materialized for each incoming kafka record and therefore
  throttling and ordering of messages would be lost

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

Remove recoverWithRetries steps because they were only needed for MergeHub

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

Revert changes in kafka consumer streams back to use flatMapConcat

* This improves readability of the code
* Multiple materialization is prevented by materializing each sink used in
  'processTransformationResult' with MergeHub on stream initialization

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

Polished the Ditto project landingpage
by adding:
* a few sentences on what Ditto is about
* a supergraphic
* Ditto's role in an IoT solution
* an overview graphic
* + adjusted the "3 columns" Ditto provides at the top of the landing page

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

fixed formatting of JSON examples
* also did some fixing on landingpage + rewording

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

explicitly configure MongoDB query batchSize same as the limit
in order to improve query performance

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

Count only successfully mapped outcomes into throttling

* Otherwise dropped messages would also slow down consuming

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

added slides for EclipseCon 2021 IoT community day

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

fixed a bug where an additional source status is shown when a mqtt source has two or more addresses;
add method to determine the number of consumers in BaseClientActor and RetrieveConnectionStatusAggregatorActor because number of consumers is calculated differently for mqtt sources;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>

Fix timeout of acknowledgement aggregator

* Before this the ReceiveTimeout did only play a role if only one
  acknowledgement was requested or non of multiple acknowledgements
  were deilvered.
  Because after receiving the first acknowledgement ReceiveTimeout
  will be canceled and therefore the second acknowledgement could take
  much longer

Signed-off-by: Yannic Klem <yannic.klem@bosch.io>

simplify construction of sinks in kafka consumer streams

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>
Merge branch 'dev' into feature/simplify-connection-config
Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

publish connection logs via fluency library to fluentd/fluentbit
* added new FluentPublishingConnectionLogger
* pulled out common ConnectionLogger functionality to abstract base class AbstractConnectionLogger
* added CompoundConnectionLogger which takes several ConnectionLoggers and applies logging operations on all of them
* added InforProvider context to several connection logs where previously missing, e.g. in order to get correlation-id always
* open TODO: build Fluency logger based on own, new config

Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

align sourceStatus presentation for status "unknown/failure/misconfiguration" with status open for mqtt connection;
don't split up source addresses for mqtt sources;

Signed-off-by: Stefan Maute <stefan.maute@bosch.io>