beam
https://github.com/apache/beam
Java
Apache Beam is a unified programming model for Batch and Streaming data processing.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Java not yet supported33 Subscribers
View all SubscribersAdd a CodeTriage badge to beam
Help out
- Issues
- [Task]: Explore use of beam.BatchElements in MLTransform.
- [Feature Request]: Improve Type Hinting of fuctions passed to beam.Map()
- [Feature Request]: enable setting max_writer_per_bundle for avroIO and other IO
- [Feature Request]: Capture pipeline error
- [Task]: Create MLTransform notebooks for each transform
- [Task]: Set beam schema proto field in user_type in typehint/schemas.py
- [RRIO]: Add retryAfter field to UserCodeQuotaException
- [RRIO]: PubsubIO.FixedRateRead pulls from Pub/Sub at a fixed rate
- [Feature Request]: Introduce a merged environment type
- [Task]: Support Vertex AI model garden for Vertex AI embeddings
- Docs
- Java not yet supported