beam
https://github.com/apache/beam
Java
Apache Beam is a unified programming model for Batch and Streaming data processing.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Java not yet supported33 Subscribers
Add a CodeTriage badge to beam
Help out
- Issues
- [Bug]: WriteToFiles in python leave few records in temp directory when writing to large number (100+) of files
- Google Cloud Storage TextIO read fails with gz-files having Content-Encoding: gzip header
- Beam worker closing gRPC connection with many workers and large shuffle sizes
- [Bug]: Beam Python failure for dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest.test_metrics_it
- [Bug]: Default PubsubMessage coder will drop message id and orderingKey
- [Bug]: When using beam.io.kinesis.ReadDataFromKinesis, a java error is raised in DataFlowRunner
- PulsarIOTest.testReadFromSimpleTopic is very flaky
- [Feature Request]: Upgrade or provide ETA on dill
- [Bug]: Google Colab DataFrame example crashes with dependency conflict
- [Bug]: Direct Runner sometimes rises `RuntimeError: dictionary changed size during iteration`
- Docs
- Java not yet supported