proxy field in proxy config is required at all times now. However, shouldn't be needed when used for publishing to Kafka/Kinesis/Nats/etc. We should adapt validation and proxy code to not require it in this case.

We should create an integration test that splits up a big file or it performs an expected mathematical operations on generating records, in a way that the output can be inferred and checked.

e.g.:

• splits up a 100MB video file into several 1MB files, sends to the commit log, re-assemble the file and checks md5 of the original and the re-assembled.
• create a series of events that have rando

I am able to use consume the Kinesis stream using this jar as a normal consumer. When i updated the user account to Enhanced fan out consumer, i am unable to access the stream.

Do we have any way to access the stream as Enhanced fan out consumer?