#

batch-processing

Here are 432 public repositories matching this topic...

faast.js

faastjs / faast.js

Serverless batch computing made simple.

javascript library typescript serverless faas batch batch-processing

Updated Jun 1, 2022
TypeScript

hazelcast-jet

hazelcast / hazelcast-jet

Open

Inject dependencies into aggregation pipeline stage

cw124 commented Jul 15, 2020

For example, given a simple pipeline such as:

Pipeline p = Pipeline.create();
p.readFrom(TestSources.items("the", "quick", "brown", "fox"))
 .aggregate(aggregator)
 .writeTo(Sinks.logger());

I'd like aggregator to be something requiring a non-serialisable dependency to do its work.

I know I can do this:

Pipeline p = Pipeline.create();
p.readFrom(TestSource

Read more

enhancement good first issue community

Open

Lamdba serialisation issue when client and server main class names clash

2

Open

Print metrics while job is running

Find more good first issues

bbottema / simple-java-mail

Simple API, Complex Emails (Jakarta Mail smtp wrapper)

Updated May 13, 2022
Java

spring-cloud / spring-cloud-dataflow

A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes

orchestration stream-processing cloud-native microservices-architecture predictive-analytics batch-processing datapipelines

Updated May 30, 2022
Java

alessandrofrancesconi / gimp-plugin-bimp

BIMP. Batch Image Manipulation Plugin for GIMP.

plugin c gimp image-manipulation batch-processing

Updated Mar 28, 2022
C

j-easy / easy-batch

The simple, stupid batch framework for Java

java batch batch-processing

Updated May 20, 2022
Java

spring-cloud / spring-cloud-task

Short lived microservices with Spring Batch

microservices batch-processing short-lived-microservices

Updated Jun 1, 2022
Java

reidmorrison / rocketjob

Ruby's missing background and batch processing system

sidekiq mongoid compression encryption mongodb resque batch batch-file delayed-jobs batch-job batch-processing batch-framework

Updated May 18, 2022
Ruby

Azure / batch-shipyard

Simplify HPC and Batch workloads on Azure

docker serverless hpc azure containers gpu mpi slurm nfs singularity azure-batch azure-functions glusterfs rdma infiniband batch-processing windows-containers

Updated May 19, 2022
Python

streamnative / pulsar-flink

Elastic data processing with Apache Pulsar and Apache Flink

schema sql catalog schema-registry stream-processing pulsar apache-flink flink data-processing batch-processing flink-stream-processing apache-pulsar flink-connector

Updated May 27, 2022
Java

avilum / linqit

Extend python lists operations using .NET's LINQ syntax for clean and fast coding.

python linq syntax metadata awesome csharp dotnet clean-code metaprogramming efficiency clean python3 lazy-loading filters pythonic batch-processing powerful development-tools robustness

Updated Jun 6, 2021
Python

tintinweb / ida-batch_decompile

Sponsor

*Decompile All the Things* - IDA Batch Decompile plugin and script for Hex-Ray's IDA Pro that adds the ability to batch decompile multiple files and their imports with additional annotations (xref, stack var size) to the pseudocode .c file

reverse-engineering ida decompile ida-plugin batch-processing ida-batch-decompile

Updated May 14, 2020
Python

krita-batch-exporter

GDQuest / krita-batch-exporter

A Free Krita plugin to batch export layers and groups with maximum flexibility. Scale, trim, export multiple copies of your layers...

exporter game-development image-processing graphic-design batch-processing krita krita-plugin

Updated Mar 7, 2022
Python

guillermo-navas-palencia / optbinning

Open

Tutorial BinningProcessSketch

guillermo-navas-palencia opened Apr 26, 2021

documentation good first issue

Open

Save optimal binning object in JSON format

Open

Unit testing Piecewise binning algorithms

btargac / excel-parser-processor

Automate Excel downloads in seconds. Simply does the tedious, repetitive operations for all rows of excel files step by step and reports after the job is done. It can download files from URL(s) in a column of Excel files. If a new filename is provided at column B it will rename the file before saving. It will even create sub folders if column C is filled with a valid folder name.

electron nodejs downloader download excel rename batch electronjs batch-processing excel-based excel-import batch-download excel-parse exceldownload excel-download subfolder

Updated Jun 2, 2022
JavaScript

lilydjwg / pssh

Parallel SSH Tools

ssh batch-processing parallel-processing pssh

Updated Apr 29, 2022
Python

bvn-architecture / RevitBatchProcessor

Fully automated batch processing of Revit files with your own Python or Dynamo task scripts!

python dynamo batch-processing revit revit-api revit-addins revit-files revit-batch-processing revit-batch-processor

Updated May 20, 2022
Python

asakusafw / asakusafw

Asakusa Framework

java framework big-data hadoop data-flow batch mapreduce batch-processing asakusa-framework

Updated Dec 9, 2021
Java

Refefer / Dampr

Python Data Processing library

machine-learning dataflow mapreduce batch-processing

Updated Mar 13, 2020
Python

dejonghe / aws-batch-example

Example use of AWS batch

python docker aws workflow lambda cloudformation aws-lambda lambda-functions scheduled-jobs batch batch-processing aws-batch

Updated May 17, 2021
Python

FurkanOM / tf-faster-rcnn

Tensorflow 2 Faster-RCNN implementation from scratch supporting to the batch processing with MobileNetV2 and VGG16 backbones

deep-learning tf2 faster-rcnn object-detection batch-processing keras-tensorflow mobilenetv2 tensorflow2

Updated May 23, 2022
Python

seznam / euphoria

Euphoria is an open source Java API for creating unified big-data processing flows. It provides an engine independent programming model which can express both batch and stream transformations.

kafka big-data apache-spark hadoop hdfs java-api apache-flink batch-processing streaming-data unified-bigdata-processing

Updated Apr 24, 2022
Java

chrisgleissner / spring-batch-rest

REST API for Spring Batch using Spring Boot 2.2

java rest spring-boot rest-api batch java-8 spring-mvc hateoas spring-batch batch-processing swagger2 java-11

Updated Mar 31, 2021
Java

streamnative / pulsar-spark

When Apache Pulsar meets Apache Spark

data-science spark apache-spark stream-processing flink data-processing batch-processing structured-streaming spark-sql apache-pulsar

Updated Mar 15, 2022
Scala

tugrul512bit / Cekirdekler

Multi-device OpenCL kernel load balancer and pipeliner API for C#. Uses shared-distributed memory model to keep GPUs updated fast while using same kernel on all devices(for simplicity).

gpu dynamic opencl zero-copy pool load-balancer parallelism gpgpu gpu-acceleration opencl-kernels gpu-computing pipelining batch-processing multi-device multi multi-gpu iterative

Updated Feb 9, 2018
C#

opencultureconsulting / openrefine-batch

Shell script to run OpenRefine in batch mode (import, transform, export). It orchestrates OpenRefine (server) and a python client that communicates with the OpenRefine API.

docker etl openrefine bash-script code4lib batch-processing

Updated Jan 28, 2022
Shell

viney-shih / goroutines

It is an efficient, flexible, and lightweight goroutine pool. It provides an easy way to deal with concurrent tasks with limited resource.

go golang pool batch goroutines batch-processing goroutine-pool

Updated Aug 3, 2021
Go

Serede / mkvtoolnix-batch

Windows Batch script to automate batch processing using mkvtoolnix.

json options subtitles batch batch-file mkv batch-script batch-processing tracks mkvtoolnix mkvmerge audio-tracks video-track

Updated Dec 19, 2017
Batchfile

runlyio / core-dotnet

Multi-threaded batch processing and background jobs for .NET Core

multi-threading job-scheduler background-jobs job-queue batch-processing

Updated Jan 24, 2021
C#

Sidneys1 / BatchImageProcessor

A Mass Image Processing tool for Windows

c-sharp cli gui image-processing crop batch-processing image-watermark resize-options cli-flags

Updated Feb 12, 2020
C#

Improve this page

Add a description, image, and links to the batch-processing topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the batch-processing topic, visit your repo's landing page and select "manage topics."