beam
https://github.com/apache/beam
Java
Apache Beam is a unified programming model for Batch and Streaming data processing.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Java not yet supported35 Subscribers
View all SubscribersAdd a CodeTriage badge to beam
Help out
- Issues
- WriteToBigQuery: Schema auto-detection is not supported.
- BigQueryBatchFileLoads does not bundle rows correctly in streaming mode in python
- Dataflow can't pickle WeakRefDictionary
- Java SDK Harness throws IllegalStateException with user states in finishBundle
- Respect timestamp OutputTime Windowing Strategy configuration in Lifted CombineFns.
- Java + Universal Local Runner: custom WindowFn support seems incomplete
- Python SDK should set merge status to "ALREADY_MERGED"
- Writing containers containing nested Decimal to BigQuery fails
- Unbounded sources unable to recover from checkpointMark when withMaxReadTime() is used
- HDFS file writing has intermittent failures from 2.16 (and above)
- Docs
- Java not yet supported