Cloudflow 2.0.22

📣 Cloudflow 2.0.22 released!

We are pleased to announce another release of Cloudflow! 🚀
This release features, among the others:

• generic ByteArray Inlet/Outlet thanks to @blublinsky
• easy debugging for streamlets in runLocal mode thanks to @franciscolopezsancho
• configuration of container ports and support for port annotations by @RayRoestenburg and @franciscolopezsancho
• a new configuration command in the Cli to retrieve the current configuration thanks to @andreaTP

NOTE
Starting from this release the Cli becomes more and more the ultimate owner of the configuration of the streamlets.
Some configuration logic has been moved from the operator to the Cli, but keeping most of the retrocompatibility:

	operator >= 2.0.13	operator >= 2.0.22
kubectl_cloudflow >=2.0.22	✅	✅
kubectl_cloudflow >=2.0.13	✅	❌

Basically, if you upgrade the operator you need to upgrade the Cli as well. User applications are not affected.

📗 What’s Changed

• Remove Streamlet configurations creation #945 by @andreaTP
• Use alpine moving tag for base images #947 by @andreaTP
• Index only current and remove development documentation #946 by @andreaTP
• Bump testcontainers #944 by @andreaTP
• Upgrade to Yq4 #942 by @andreaTP
• Remove component selector below TOC and Edit this page #938 by @rstento
• Fix search box #939 by @andreaTP
• Check scalafmt in CI #936 by @andreaTP
• Remove a bunch of intermediate releases from docs to avoid Antora OOM #935 by @andreaTP
• Implementing search for cloudflow.io docs #916 by @andreaTP
• Remove integration tests #934 by @andreaTP
• Fix installation instructions of the Spark operator #933 by @andreaTP
• Remove minor typos in documentation #931 by @andreaTP
• Add a flag to disable debug in runLocal #930 by @andreaTP
• adding container ports to akka streamlet through configuration, annotations for akka, spark and flink. #922 by @franciscolopezsancho
• Add ByteArray Inlet/Outlet, fixed some deprecated messages #907 by @blublinsky
• added params to LocalPlugin and docs #929 by @franciscolopezsancho
• Update whitesource results from CI #928 by @andreaTP

🙇 Credits

Special thanks to the following contributors who helped with this release: @andreaTP, @blublinsky, @franciscolopezsancho and @rstento

Kubectl plugin download links:

• Linux
• MacOS
• Windows

Cloudflow 2.0.21

📣 Cloudflow 2.0.21 released!

We are pleased to announce another release of Cloudflow.

This release introduces an easy way to configure logging in the applications, adds documentation on how to use a debugger in cloudflow applications (thanks to @franciscolopezsancho ) and, fixes a couple of minor regressions introduced in 2.0.20 in the operator and the cli.

📗 What’s Changed

• Easy logging #924 by @andreaTP
• Check whitesource in CI #927 by @andreaTP
• Whitesource #926 by @andreaTP
• Re-introduce retries on secret #925 by @andreaTP
• Testing and documenting debugging #923 by @franciscolopezsancho
• Fix the version retrieval of the kubectl-cloudflow command #921 by @andreaTP
• Wipe clusters script #919 by @andreaTP
• suggest Strimzi only for development #920 by @andreaTP
• Fix retrieval of the lastest cli version in docs #917 by @andreaTP

🙇 Credits

Special thanks to the following contributors who helped with this release: @andreaTP, @franciscolopezsancho and Cloudflow @lightbend

Kubectl plugin download links:

• Linux
• MacOS
• Windows

Cloudflow 2.0.20

📣 Cloudflow 2.0.20 released! 📣

We are pleased to announce another release of Cloudflow!

This release features improved stability in the operator, a few minor bug fixes, and two major features:

🤖 Deprecation of runtime base images
From now on Docker images are going to be built on top of standard adoptopenjdk/openjdk8 and this gives additional flexibility for customization.
Runtime specific base images usage has been deprecated (e.g. cloudflowFlinkBaseImage), if you are still using those simply add additional instructions to extraDockerInstructions.

🚀 New kubectl-cloudflow plugin
With this release, we ship a new kubectl plugin with additional features!

• Improved output formats: you can tweak the output by using the option -o or --output (or the KUBECTL_CLOUDFLOW_OUTPUT_FORMAT environment variable) available options are:c or classic (the previous cli output), t or table(the new default for improved human readability), json and yaml
• Improved debugging capabilities: using -v or --log-level you can tweak the internal logging level of the cli itself
• Improved configuration validations and error handling (try it out! 🤓 )

NOTE: From the utilization perspective, nothing changes apart from the need for an = sign in between the streamlet name and the number of replicas in the scale subcommand.

📗 What’s Changed

• Start using kubectl-cloudflow repo #915 by @andreaTP
• Remove the old Cli #914 by @andreaTP
• Use the new Cli for integration tests #895 by @andreaTP
• Deprecate runtime specific base images #911 by @andreaTP
• Execute actions in sequence and not in parallel #912 by @andreaTP
• fix: disable the http parsing limit size #908 by @andreaTP
• Add missing sbt-dynver plugin #909 by @vkorenev

🙇 Credits

Special thanks to the following contributors who helped with this release: @andreaTP and @vkorenev

Kubectl plugin download links:

• Linux
• MacOS
• Windows

Cloudflow 2.0.19

📣 Cloudflow 2.0.19 released!

We are pleased to announce another release of Cloudflow.

Streamlet inlets now automatically skip and log decoding errors.
It is possible to modify this behavior by using withErrorHandler on an inlet.
EmbeddedKafka does not work with Kafka 2.6+, so runLocal now uses testcontainers instead. It's also possible to use runLocalKafka sbt setting to runLocal against an existing Kafka cluster.
Cloudflow now supports sbt 1.4.x, all projects are now using sbt 1.4.4 and projects are cross-compiled to Scala 2.12 and Scala 2.13.

This patch release also fixes two issues that have been reported in 2.0.18.

📗 What’s Changed

• Enable external kafka for runLocal #904 by @andreaTP
• Disable the default secrets creation #902 by @andreaTP
• Refactored error handling #897 by @blublinsky
• A first cut at reinstating sharing for the documentation #901 by @andreaTP
• avoiding taskmanager.memory.flink.size override #899 by @franciscolopezsancho
• Creating streamlet secrets if missing in cli #900 by @RayRoestenburg
• Less restrictions on actions. #891 by @RayRoestenburg
• Fix Flink Docker image creation with upstream artifacts #893 by @andreaTP
• Enable cross-compilation of the operator #894 by @andreaTP
• Bump sbt to latest #890 by @andreaTP
• Add more context to gRPC example #892 by @raboof
• Improved check for application version. #889 by @RayRoestenburg
• Cross compile streamlet with 2.13 #876 by @andreaTP
• Use testcontainers instead of EmbeddedKafka #880 by @andreaTP
• Moved app down to resource action. #885 by @RayRoestenburg

🙇 Credits

Special thanks to the following contributors who helped with this release: @RayRoestenburg, @andreaTP, @blublinsky, @franciscolopezsancho, @raboof and Cloudflow @lightbend

Kubectl plugin download links:

• Linux
• MacOS
• Windows

Cloudflow 2.0.18

📣 Cloudflow 2.0.18 released!

We are pleased to announce another release of Cloudflow.

Some important changes:

• increasing memory to be able to handle more applications.
• fix: reconciling with secrets after handling exceptions on unstable Kubernetes clusters.

📗 What’s Changed

• Fix: Always getting current objects on watch restart. #881 by @RayRoestenburg
• Keep state on source restart #878 by @RayRoestenburg
• Fix failing GH Actions CI #877 by @andreaTP
• Force re-indexing of stable repository #875 by @andreaTP
• Downgrade Sbt version for users #873 by @andreaTP
• Bump sbt #872 by @andreaTP
• Minor fix #871 by @RayRoestenburg
• Fix docs generation for cross-build #870 by @andreaTP
• Controlled shutdown of Kafka consumers #861 by @ennru
• cloudflow operator action refactoring. #868 by @RayRoestenburg
• Scala213 op #866 by @RayRoestenburg
• Recover from TCP exception during create, update and patch for underp… #865 by @RayRoestenburg

🙇 Credits

Special thanks to the following contributors who helped with this release: @RayRoestenburg, @andreaTP, @ennru and Cloudflow @lightbend

Kubectl plugin download links:

• Linux
• MacOS
• Windows

Cloudflow 2.0.14

📣 Cloudflow 2.0.14 released!

We are pleased to announce another release of Cloudflow.

Among other things this release makes the operator handle some issues in underprovisioned environments

📗 What’s Changed

• Retry get in provided action. #864 by @RayRoestenburg
• Execute status error action on action failure. #859 by @RayRoestenburg
• Restructure Akka Streamlet lifecycle signalling #853 by @ennru
• Fix the Makefile to provision the PVCs #857 by @andreaTP
• added fix to avoid confusion when /mnt/[runtime]/storage is already present in the conf but is not in mount-path #858 by @franciscolopezsancho

🙇 Credits

Special thanks to the following contributors who helped with this release: @RayRoestenburg, @andreaTP, @ennru, @franciscolopezsancho and Cloudflow @lightbend

Kubectl plugin download links:

• Linux
• MacOS
• Windows

Cloudflow 2.0.13

📣 Cloudflow 2.0.13 released!

We are pleased to announce another release of Cloudflow.

Please find the release notes at https://github.com/lightbend/cloudflow/blob/master/release-notes/cloudflow-2.0.13.md

📗 What’s Changed

• Remove storage class, not needed anymore in the operator. #854 by @RayRoestenburg
• Flink taskmanager taskSlots, parallelism.default, jobmanager.replicas is now configurable. #850 by @RayRoestenburg
• Fix the generation of the scala/java docs for all the released version #851 by @andreaTP
• Improvements to restart of streams in the operator. #852 by @RayRoestenburg
• Separate runners. #843 by @RayRoestenburg
• Cloudflow spark operator doesn't allow version updates #845 by @andreaTP
• Cleanup actions #842 by @RayRoestenburg
• PVC avoiding init creation #841 by @franciscolopezsancho
• Separate usage of akka streams from actions #840 by @RayRoestenburg
• Moving events, actions and runners to separate lib. #839 by @RayRoestenburg
• Fix version of the operator charts #837 by @andreaTP

🙇 Credits

Special thanks to the following contributors who helped with this release: @RayRoestenburg, @andreaTP, @franciscolopezsancho and Cloudflow @lightbend

Kubectl plugin download links:

• Linux
• MacOS
• Windows

Cloudflow 2.0.12

📣 Cloudflow 2.0.12 released!

We are pleased to announce another release of Cloudflow.

Please find the release notes at https://github.com/lightbend/cloudflow/blob/master/release-notes/cloudflow-2.0.12.md

📗 What’s Changed

• Fix the run command for integration tests #835 by @andreaTP
• change the chat badge to Zulip #834 by @andreaTP
• helm stable repo has moved; old one will go in 2 weeks #832 by @laszlovandenhoek
• Reporting error status in kubectl cloudflow status for unrecoverable errors. #830 by @RayRoestenburg
• Force incompatible change, users must update kubectl cloudflow and op… #831 by @RayRoestenburg
• Bump Kafka version in integration tests Makefile #829 by @andreaTP
• Add one more note on exporting CLOUDFLOW_VERSION #828 by @andreaTP
• Kafka 2.4.0 support removed in Strimzi 0.20.0 #825 by @laszlovandenhoek
• Fix documentation #827 by @andreaTP
• CI: Coursier caching #826 by @ennru
• Mention CLOUDFLOW_VERSION in the docs to run the examples #823 by @andreaTP
• Fixes for antora current version updates #822 by @andreaTP
• Edit Apache Flink entry script to prevent task manager memory setting overriding #812 by @Lockdain
• Removed unused code and moved “docker_client” code to image package. #811 by @RayRoestenburg
• No need anymore to set current docs version based on master #810 by @andreaTP
• Auto docs generation #802 by @andreaTP
• Remove disks after cluster deletion #808 by @andreaTP
• Remove references to the installer from the docs #807 by @andreaTP
• Fix cr image names #806 by @andreaTP
• Fix duplicated log output for image version #804 by @andreaTP
• Minor fixes to the integration tests Makefile #801 by @andreaTP
• Remove the PR labeler #800 by @ennru
• Use an async appender for logging #799 by @andreaTP

🙇 Credits

Special thanks to the following contributors who helped with this release: @Lockdain, @RayRoestenburg, @andreaTP, @ennru, @laszlovandenhoek and Cloudflow @lightbend

Kubectl plugin download links:

• Linux
• MacOS
• Windows

Cloudflow 2.0.11

📣 Cloudflow 2.0.11 released!

We are pleased to announce another release of Cloudflow.

Please find the release notes at https://github.com/lightbend/cloudflow/blob/master/release-notes/cloudflow-2.0.11.md
Cloudflow is installed with helm charts. Please see Cloudflow Administration Tasks.

📗 What’s Changed

• Automate local it tests #798 by @andreaTP
• Removed old installer. #797 by @RayRoestenburg
• Simplified Spark implementation, Added Protobuf support to Spark. #734 by @blublinsky
• Fixes: Merge default named Kafka cluster config as fallback to any global topic config #795 by @andreaTP
• Multi out support as non-public API #780 by @ennru
• Fix java opts flink config issue 781 #796 by @franciscolopezsancho
• added to the jvm args in the right order #789 by @franciscolopezsancho
• Operator exceptions to status #791 by @RayRoestenburg
• Easier execution of it tests #788 by @andreaTP
• Extract ascii visualization as dedicated task #787 by @thomasschoeftner
• Release CI tweaks #784 by @andreaTP
• Some fixes in the operator #786 by @RayRoestenburg
• Added example showing how to use protobufs in Flink/Akka Stream #737 by @blublinsky
• Fix run local logging for Flink streamlets. #779 by @RayRoestenburg
• Fixed Flink filesystem initialization. #775 by @blublinsky
• Fix bugs relating to not using a namespace when calling K8s API #774 by @RayRoestenburg
• [sbt-plugin] Make the publishing to a docker registry optional #768 by @andreaTP
• [clean] Housekeeping a bunch of warnings in the operator #772 by @andreaTP
• Mounting existing pvcs through conf #764 by @franciscolopezsancho
• [docs] Improve logging configuration documentation. Fix #58 #769 by @andreaTP
• [compat] Increase JDK compatibility matrix #763 by @andreaTP
• Add methods to change Spark session and Flink streaming env from the streamlet. #765 by @RayRoestenburg
• [docs] Improve the testing section of the local example to be self contained #762 by @andreaTP
• [docs] Add local resources files to the getting started guide #761 by @andreaTP
• [docs] Fixes and improvements to the getting started guide #760 by @andreaTP
• Named Kafka cluster configurations #708 by @seglo
• Replacing ${?VAR}, ${VAR} and $VAR environment/shell variables with values in config #751 by @RayRoestenburg
• Document grpc ingress better #746 by @raboof
• Check for broken internal links in CI #740 by @raboof
• Fix broken internal documentation links #741 by @raboof
• Fix 'make check-links' in docs #729 by @raboof
• Respond with '200' on the root of gRPC routes #744 by @raboof
• Use Await.result in cloudflow-operator #738 by @patriknw
• deleting secret after it has been checked it has been mounted #735 by @franciscolopezsancho
• Fixed Partitioner support for Flink CodecOutlet support #733 by @blublinsky
• CloudflowAkkaPlugin instead of non-existant Plugin #730 by @ignasi35
• Adds link to credentials site #727 by @ignasi35
• Update Admin documentation #716 by @blublinsky
• Higher timeout setting for subscription to response entity. #726 by @RayRoestenburg
• Add link to installer docs #725 by @raboof
• Patch config labels uppercase #724 by @franciscolopezsancho
• Mounting secrets in pods integration test #721 by @franciscolopezsancho
• Modified Kafka settings in strimzi example, noted this is purely for testing #719 by @RayRoestenburg
• runLocalLog4jConfigFile setting for custom log4j configuration used in runLocal. #715 by @RayRoestenburg
• Auto-label PRs #700 by @ennru
• Add documentation adding Additional libraries #705 by @blublinsky
• Update documentation to remove incorrect Flink version #704 by @justinhj
• Add (non-scalapb) javadsl for protobuf inlet/outlet #698 by @raboof
• Extract config layering #696 by @ennru

🎯 Dependencies

• Update to Akka 2.6.9. #753 by @RayRoestenburg
• Update to Alpakka Kafka 2.0.5 #728 by @ennru
• Update Skuber to use the same Akka version as the rest #628 by @raboof

🙇 Credits

Special thanks to the following contributors who helped with this release: @RayRoestenburg, @andreaTP, @blublinsky, @ennru, @franciscolopezsancho, @ignasi35, @justinhj, @patriknw, @raboof, @seglo and @thomasschoeftner

Kubectl plugin download links:

• Linux
• MacOS
• Windows

Cloudflow 2.0.10

📣 Cloudflow 2.0.10 released!

We are pleased to announce another release of Cloudflow.

Please find the release notes at https://github.com/lightbend/cloudflow/blob/master/release-notes/cloudflow-2.0.10.md
Cloudflow is now installed with helm charts. Please see Cloudflow Administration Tasks.

📗 What’s Changed

• 2.0.10 release manual updates #699 by @RayRoestenburg
• Enable release drafter #697 by @ennru
• Enable HTTP2 by default #695 by @raboof
• Consolidating from developer docs #693 by @franciscolopezsancho
• Topic config overrides #689 by @RayRoestenburg
• runLocal in Test scope #692 by @RayRoestenburg
• operator: remove some Strimzi left-over settings #690 by @ennru
• adding page for storage, fixing broken links and showing hidden prerequisites #688 by @franciscolopezsancho
• Include server in kafka configmap #687 by @RayRoestenburg
• Update example to enable logging #686 by @blublinsky
• Add documentation for using Azure Blob storage from Flink (local and deployed to Cloudflow #682 by @justinhj
• Prepare the namespace of the application depending on the runtime that is used. #672 by @olofwalker
• Kafka topic creation via admin clients #640 by @ennru
• Add documentation for Spark and Flink new features #679 by @blublinsky
• docs: restructure the administration section #677 by @ennru
• AKS script typo, CLUSTER_VERSION -> K8S_VERSION #676 by @tringuyen-yw
• cloudflow.runtimes.flink.config support for local run #655 by @blublinsky
• Add getRejectionHandler to report http errors in the log #606 by @blublinsky
• Add Spark trigger support #667 by @blublinsky
• Embed the Akka gRPC plugin #642 by @raboof
• docs: add metadata for the pom's and Scaladoc #670 by @ennru
• docs: update the helm-base installation instructions #675 by @ennru
• Update Ingress documentation to link to examples for authenticated ingress #674 by @RoryStokes
• Updating the documentation to describe the new installation procedure. #654 by @olofwalker
• Adding labels to pods #653 by @franciscolopezsancho

🙇 Credits

Special thanks to the following contributors who helped with this release: @RayRoestenburg, @RoryStokes, @blublinsky, @ennru, @franciscolopezsancho, @justinhj, @olofwalker, @raboof and @tringuyen-yw

Kubectl plugin download links:

• Linux
• MacOS
• Windows