Apache Spark

Apache Spark is an open source distributed general-purpose cluster-computing framework. It provides an interface for programming entire clusters with implicit data parallelism and fault tolerance.
Here are 5,144 public repositories matching this topic...
-
Updated
Oct 1, 2020 - Python
-
Updated
Oct 28, 2020 - Go
-
Updated
Oct 31, 2020 - JavaScript
-
Updated
Nov 2, 2020 - Python
Hey!
Currently, there are no plans to add support for it (from core team), but we are happy to merge and help with contribution from the community.
For driver implementer, take a look at
https://github.com/cube-js/cube.js/blob/master/CONTRIBUTING.md#implementing-sql-dialect
Example of driver implementation
Who are interested in prepari
-
Updated
Oct 17, 2020 - Java
-
Updated
Oct 31, 2019
-
Updated
Nov 2, 2020 - Java
-
Updated
Oct 29, 2020 - Java
-
Updated
Jun 20, 2020 - Python
-
Updated
Nov 1, 2020 - Jupyter Notebook
-
Updated
Nov 1, 2020 - Java
-
Updated
Apr 24, 2020 - Jsonnet
-
Updated
Oct 30, 2020 - Scala
-
Updated
Jul 27, 2020 - Python
-
Updated
May 26, 2019 - Scala
-
Updated
Jun 2, 2020 - JavaScript
Hi, if my spark app is using 2 storage type, both S3 and Azure Data Lake Store Gen2, could I put spark.delta.logStore.class=org.apache.spark.sql.delta.storage.AzureLogStore, org.apache.spark.sql.delta.storage.S3SingleDriverLogStore
Thanks in advance
-
Updated
Oct 8, 2020 - Jupyter Notebook
I have a simple regression task (using a LightGBMRegressor) where I want to penalize negative predictions more than positive ones. Is there a way to achieve this with the default regression LightGBM objectives (see https://lightgbm.readthedocs.io/en/latest/Parameters.html)? If not, is it somehow possible to define (many example for default LightGBM model) and pass a custom regression objective?
Problem
Since Java 8 was introduced there is no need to use Joda as it has been replaced the native Date-Time API.
Solution
Ideally greping and replacing the text should work (mostly)
Additional context
Need to check if de/serializing will still work.
Created by Matei Zaharia
Released May 26, 2014
- Repository
- apache/spark
- Website
- spark.apache.org
- Wikipedia
- Wikipedia
At this moment relu_layer op doesn't allow threshold configuration, and legacy RELU op allows that.
We should add configuration option to relu_layer.