beam
https://github.com/apache/beam
Java
Apache Beam is a unified programming model for Batch and Streaming data processing.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Java not yet supported31 Subscribers
Add a CodeTriage badge to beam
Help out
- Issues
- [Task]: Upgrade to Pandas 2.2.3 or above once available
- Update ExternalJavaProvider.available method to support Windows systems
- [Bug]: Portable Spark 3 Streaming runner appears to have GBK bugs, cannot execute Redistribute composite correctly
- [Bug]: Improve handling of 'not found' BigQuery dataset/table errors with appropriate retry policy
- [Bug]: Python expansion with multiple SqlTransforms is extremely slow
- [Failing Test]: PostCommit Java Dataflow V2 - repeat intermittant failures
- [Failing Test]: beam_PostCommit_Java_ValidatesRunner_Dataflow_V2 - repeat intermittant failures
- [Failing Test]: PostCommit Python and PostCommit Python Arm perma red
- [Feature Request]: Add an example that uses Iceberg I/O via the Managed API
- [Feature Request]: Add `with_exception_handling()` for PTransforms in Python
- Docs
- Java not yet supported