beam
https://github.com/apache/beam
Java
Apache Beam is a unified programming model for Batch and Streaming data processing.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Java not yet supported35 Subscribers
Add a CodeTriage badge to beam
Help out
- Issues
- Create DlpIO connector to interact with DLP batch job
- Investigate python hash libraries
- PubsubIO can't provide PubsubClientFactory
- GcsPath should support file generation
- ElasticsearchIO performs 0 division on DirectRunner
- Date type mapping from AVRO to Beam Schema produces invalid schema when used with Beam SQL
- gcloud crashed (TypeError): a bytes-like object is required, not 'str'
- Remove _CustomBigQuerySource implementation to rely on ReadAllFromBigQuery
- Add alternate Sorting transform as an implementation of CombineFn
- Specify the event time when consuming pubsub data.
- Docs
- Java not yet supported