1,313 questions
0
votes
0
answers
60
views
Consumer with manual ack and transactional producer in SCDF processor
I'm using SCDF 2.11 and I'm trying to implement processors in which we don't want to lose any message.
So we want our producers to be transactional and the consumers to acks messages only if they are ...
1
vote
0
answers
50
views
Problem when running composed tasks on spring cloud data flow
I am having problems with composed tasks on spring cloud data flow, I get the following error
2025-04-03 15:06:40.357 INFO 2040 --- [ main] o.s.c.d.c.ComposedTaskRunner : ...
0
votes
0
answers
36
views
Problem with OAuth2 and Spring Clound Dataflow/Skipper
Here's the context of my task that I'm not able to achieve : We have a component (an app) that is deployed to Spring Cloud Dataflow and is then used by streams that we define. Everythings works great ...
0
votes
0
answers
56
views
Spring cloud data flow ''Failed to start bean 'taskLifecycleListener'' error
I am trying to run a Spring Batch task in Spring Cloud Data Flow (SCDF), but every time I execute it, the task status remains unknown, and I get the following error in the logs:
stdout:
. ____ ...
-1
votes
1
answer
84
views
Spring cloud data flow java version mismatch
i am following the documentation tutorial of spring cloud data flow and when i try to run the default task timestamp i face this error :
stderr:
Error: LinkageError occurred while loading main class ...
0
votes
1
answer
61
views
TIMEZONE issues in apps deployed with SCDF
I've deployed locally with docker and tried different settings, but the timestamp of the task is not applied as I want.
services:
mysql:
image: mysql:5.7
container_name: dataflow-mysql
...
0
votes
1
answer
41
views
How do I setup multiple directory configuration using Spring Cloud Dataflow pre-packaged SFTP source?
When using the pre-packaged SFTP source I've been unable to configure multiple directories. Does anyone have a clear example on how to set this up? Either with multiple factories or with a single ...
0
votes
1
answer
63
views
Spring Cloud Dataflow Server - NoSQL / MongoDB Database support
The latest milestone release for Spring batch (5.2.0-M2) has added support for MongoDB. Spring cloud dataflow server still requires an RDMBS (MySQL, PostgreSQL etc). Is there a feature request already ...
1
vote
1
answer
52
views
How can I import newer versions of pre-defined SCDF starter apps?
I'm working on evaluating Spring Cloud Data Flow, and want to get a demonstration working with the out of the box apps (Kafka on Kubernetes). I'm having trouble getting things working, but before I ...
0
votes
0
answers
94
views
Unable to create scheduled Tasks in SCDF - 2.11.0
I am using SCDF version 2.11.0 . Earlier I am able to create schedule tasks with CRON_TZ and it was working fine .
Recently , not able to create schedule with CRON_TZ . We are getting the below error ,...
0
votes
1
answer
83
views
Spring Cloud Data Flow - Passing secret to the Cloud Task
How to pass the secrets to a cloud task when executing through Spring Cloud Data Flow. I am trying to set the secrets using deployer properties but it's not working
Thanks for your help in advance.
...
0
votes
1
answer
24
views
Is it possible to see the request coming in to an SCDF Server?
An external service tries to start a SCDF Task with a Rest call. But I only see it's missing some properties it should have.
Is it possible to see the exact call that is coming in to the SCDF Server? ...
0
votes
1
answer
82
views
Multiple Namespace Deployer Properties in Spring Cloud Data Flow
We are in process of having a single SCDF server instance in k8s deploying stream applications to multiple namespaces based on the platformName property.
My question is when i specify a property like ...
0
votes
1
answer
93
views
How to deal with the removal of support of running multiple batch jobs at once?
Spring Batch recently removed the opportunity to run multiple batch jobs at once.
So now, you can still package multiple batch jobs into the same application but for every execution of the batch ...
0
votes
1
answer
133
views
Statefulset for apps deployed by spring cloud data flow in Kubernetes
I know this question was asked last year and that isnt supported then, but is it still the same?
in SCDF(Spring Cloud Data Flow), how can i deploy application(stream or task) as statefulset? not ...
-1
votes
1
answer
47
views
Configure Kubernetes services of Spring Cloud Dataflow streams
When Spring Cloud Dataflow deploys a stream, it delegates the actual deployment to Spring Cloud Skipper. Effectively, it is possible to configure Skipper to customize the Kubernetes deployment, using ...
0
votes
1
answer
68
views
running maven task on spring cloud data flow in kubernetes platform
I'm trying to setup spring cloud data flow to be able to run maven tasks in kubernetes cluster.
I was able to register repository in the SCDF server, and register application with maven://group:...
1
vote
1
answer
59
views
Not Able to Register app using SCDF 2.11.2 Dashboard UI due to one mandatory field (Spring boot version) which is disabled in my Application
Recently Upgraded Spring cloud dataflow from 2.9.2 to 2.11.2. After the upgrade, all the existing apps were cleaned up don't know how.
But, now I am trying to import or register these apps using the ...
1
vote
1
answer
315
views
Deploying java 17 apps on Spring cloud data flow 2.9.6
We are using spring cloud data flow version 2.9.6 and all our apps were so far on Java 8, deploying them on to pivotal cloud foundry environment.
But we are in process of migration and upgraded a ...
0
votes
0
answers
380
views
Is spring-cloud-dataflow-rest-client with Spring Boot 3 support already available?
I'm running a Spring Boot 2 application with a dependency on org.springframework.cloud:spring-cloud-dataflow-rest-client:2.11.2.
I want to upgrade my application to Spring Boot 3, but I receive the ...
0
votes
1
answer
196
views
spring-cloud-dataflow UI timezone use only UTC?
I use spring-cloud-dataflow(scdf) in the k8s environment.
The timezone was modified by changing the application property as follows.
spring.cloud.dataflow.task.platform.kubernetes.accounts.default....
0
votes
1
answer
95
views
How to create route/ingress for apps deployed via spring cloud data flow in kubernetes
We are working on setting up Spring cloud data flow in kubernetes cluster. Wanted to know how we can enable external access to deployed apps from outside the cluster.
We are basically migrating from ...
0
votes
1
answer
119
views
Spring Cloud Dataflow kafka-source-kafka throwing error
I am trying to create a steam application using SCDF kafka-source-kafka as a kafka supplier config. Below are the properties to configure the external source kafka as a consumer config.
app.kafka-...
1
vote
2
answers
307
views
Monitor and manage spring cloud data flow (SCDF) Server using Prometheus
Is it possible to monitor and manage spring cloud data flow(SCDF) server itself using Prometheus?
I am aware that, I can monitor and collect metrics for the jars deployed in SCDF Server (i.e source, ...
0
votes
1
answer
78
views
Spring Cloud Data Flow http-source application with Oauth2 Security Config
I was trying to configure the Oauth2 server on http-source-kafka connector in SCDF. There are no such properties available to configure the Oauth2 related configs.
permitted.endpoints=xxx
restricted....