beam
https://github.com/apache/beam
Java
Apache Beam is a unified programming model for Batch and Streaming data processing.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Java not yet supported35 Subscribers
Add a CodeTriage badge to beam
Help out
- Issues
- Logging from DoFn doesn't work with Spark Runner in cluster mode
- Add Parquet and Avro info into the Create External Table webpage
- Implement DataFrame.apply
- Properly support `convert_dtype=True` in Series.apply
- groupby cannot aggregate grouped column
- pandas IOs should set chunksize by peeking at input data at construction time
- Implement transform for Series and DataFrame
- DataFrame API does not preserve freq attribute in a DateTimeIndex
- SpannerIO.read() parallelism limited by partition count
- Spark PortableRunner (Python SDK) low parallelism
- Docs
- Java not yet supported