Apache Spark

Apache Spark is an open source distributed general-purpose cluster-computing framework. It provides an interface for programming entire clusters with implicit data parallelism and fault tolerance.
Here are 5,532 public repositories matching this topic...
-
Updated
Feb 18, 2021 - Python
-
Updated
Mar 30, 2021 - Python
-
Updated
Mar 24, 2021 - Go
-
Updated
Mar 30, 2021 - Python
Describe the bug
I want to connect to Redis Memory store in GCP and got the following error:
Error: Redis connection to <port> failed - unable to verify the first certificate at TLSSocket.onConnectSecure
(_tls_wrap.js:1502:34) at TLSSocket.emit (events.js:314:20) at TLSSocket._finishInit (_tls_wrap.js:937:8) at
TLSWrap.ssl.onhandshakedone (_tls_wrap.js:711:12)
*To Reproduce
-
Updated
Dec 21, 2020 - Java
-
Updated
Oct 31, 2019
-
Updated
Mar 30, 2021 - Java
-
Updated
Mar 30, 2021 - Java
-
Updated
Dec 23, 2020 - Python
-
Updated
Mar 30, 2021 - Jupyter Notebook
-
Updated
Mar 30, 2021 - Java
-
Updated
Mar 29, 2021
-
Updated
Apr 24, 2020 - Jsonnet
-
Updated
Mar 25, 2021 - Scala
-
Updated
Mar 29, 2021 - Python
-
Updated
May 26, 2019 - Scala
Hi, if my spark app is using 2 storage type, both S3 and Azure Data Lake Store Gen2, could I put spark.delta.logStore.class=org.apache.spark.sql.delta.storage.AzureLogStore, org.apache.spark.sql.delta.storage.S3SingleDriverLogStore
Thanks in advance
-
Updated
Mar 30, 2021 - JavaScript
-
Updated
Mar 15, 2021 - Jupyter Notebook
Used Spark version
2.4.3
Used Spark Job Server version
(Released version, git branch or docker image version)
0.9.0-SNAPSHOT
Deployed mode
(client/cluster on Spark Standalone/YARN/Mesos/EMR or default)
client spark standalone
Actual (wrong) behavior
curl -d "input.string = a b c a b see hello world ssdsds " 'localhost:8090/jobs?appName=test&classPath=spark.jobserver.WordCo
I have a simple regression task (using a LightGBMRegressor) where I want to penalize negative predictions more than positive ones. Is there a way to achieve this with the default regression LightGBM objectives (see https://lightgbm.readthedocs.io/en/latest/Parameters.html)? If not, is it somehow possible to define (many example for default LightGBM model) and pass a custom regression objective?
Created by Matei Zaharia
Released May 26, 2014
- Repository
- apache/spark
- Website
- spark.apache.org
- Wikipedia
- Wikipedia
At this moment relu_layer op doesn't allow threshold configuration, and legacy RELU op allows that.
We should add configuration option to relu_layer.