Category "dataflow"

Recalculate historical data using Apache Beam

I have an Apache Beam streaming project that calculates data and writes it to the database, what is the best way to reprocess all historical records after a bug

Apache Beam pipeline with Write to jdbc

I am trying to create a pipeline which is reading some data from Pubsub and writing to into a postgres database. pipeline_options = PipelineOptions(pipeline_arg

how to charge components dynamically?

I use the plugin total.js flow. I would like to know if there is a function like FLOW.Reload() to dynamically reload the components?

How to achieve flow like this

I'd like to get flow like this one on the picture. Is there any way to intercept all HTTP request within a docker container, modify their headers and then send

Why my node returns me a websocket error?

I'm putting my application on an IIS HTTP server, but I get an error: WebSocket connection to 'wss://xxxx.xxxx.xx:xxxxx/?designer=1&token=&baa=' f

Get parameter in totalJS Flow?

I would like to get parameter on my flow, for example, http://localhost:8000/?param1=12. If i want to recup param1 in my application, how and where can i do it

dynamic route for http-request in total.js flow

How to use dynamic url for http-request in total.js flow. I am able to get params from route component but how to pass this to http-request url ?

Unable to create a template

I am trying to create a dataflow template using the below mvn command And i have a json config file in the bucket where i need to read different config file for

SSIS preserve trailing spaces in csv destination

I have a problem in SSIS, with a simple data flow task between a sql SELECT and a CSV destination. I don't retrieve trailing spaces in string columns of the des