It's helpful to know what the default parameters were in the papers to get started. We should add the default projection head parameters which were used for pre-training on Imagenet to all projection and prediction heads in lightly/models/modules/heads.py.

Add examples for all ApiWorkflow functions

17

Open

Add multi-modal loss

4

Find more good first issues

lucidrains / byol-pytorch

Star

Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorch

deep-learning artificial-intelligence self-supervised-learning

Updated Jul 15, 2021
Python

s3prl / s3prl

Star

Open

MOSEI downstream task not yet support DDP

2

Sreyan88 commented Sep 11, 2021

Hi there,

I try the command:

CUDA_VISIBLE_DEVICES=4,5 python3 -m torch.distributed.launch --nproc_per_node 2
 run_downstream.py -m train -u wav2vec2 -d mosei -n HelloWorld --upstream_trainable --upstream_feature_selection hidden_state_5

and get the error:

AttributeError: 'RandomSampler' object has no attribute 'set_epoch'
overall:   0%|

Config changes not getting reflected when using custom config .yaml filr

1

Open

Errors in Mosei downstream

8

divelab / DIG

Star

A library for graph deep learning research

deep-learning graph-generation explainable-ml self-supervised-learning 3d-graph graph-neural-network

Updated Mar 5, 2022
Python

wvangansbeke / Unsupervised-Classification

Star

SCAN: Learning to Classify Images without Labels, incl. SimCLR. [ECCV 2020]

clustering image-classification representation-learning unsupervised-learning moco self-supervised-learning simclr eccv2020 eccv-2020 contrastive-learning

Updated Oct 2, 2021
Python

vturrisi / solo-learn

Star

solo-learn: a library of self-supervised methods for visual representation learning powered by Pytorch Lightning

Updated Mar 10, 2022
Python

asheeshcric / awesome-contrastive-self-supervised-learning

Star

A comprehensive list of awesome contrastive self-supervised learning papers.

deep-learning transfer-learning representation-learning unsupervised-learning self-supervised-learning hacktoberfest-accepted

Updated Jan 9, 2022

TorchSSL / TorchSSL

Star

A PyTorch-based library for semi-supervised learning (NeurIPS'21)

machine-learning computer-vision deep-learning toolkit pytorch semi-supervised-learning codebase self-supervised-learning

Updated Feb 25, 2022
Python

jackroos / VL-BERT

Star

Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".

pytorch representation-learning bert vision-and-language self-supervised-learning pre-training iclr2020 vl-bert

Updated Feb 11, 2022
Jupyter Notebook

zhirongw / lemniscate.pytorch

Star

Unsupervised Feature Learning via Non-parametric Instance Discrimination

computer-vision deep-learning pytorch imagenet representation-learning unsupervised-learning nce cvpr2018 self-supervised-learning

Updated Mar 25, 2021
Python

ChandlerBang / awesome-self-supervised-gnn

Star

Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).

machine-learning deep-learning graph-mining graph-neural-networks self-supervised-learning pre-training pretraining

Updated Mar 10, 2022

YyzHarry / imbalanced-semi-self

Star

[NeurIPS 2020] Semi-Supervision (Unlabeled Data) & Self-Supervision Improve Class-Imbalanced / Long-Tailed Learning

semi-supervised-learning class-imbalance imbalanced-data imbalanced-learning long-tail unlabeled-data self-supervised-learning neurips imbalanced-classification neurips-2020 long-tailed-recognition

Updated Apr 3, 2021
Python

LirongWu / awesome-graph-self-supervised-learning

Star

Awesome Graph Self-Supervised Learning

machine-learning deep-learning transfer-learning representation-learning unsupervised-learning data-augmentation graph-neural-networks self-supervised-learning pre-training pretext-task

Updated Feb 22, 2022

MrGiovanni / ModelsGenesis

Star

Official Keras & PyTorch Implementation and Pre-trained Models for Models Genesis - MICCAI 2019

transfer-learning representation-learning 3d-model fine-tuning self-supervised-learning pre-trained-model

Updated Feb 18, 2022
Jupyter Notebook

Megvii-BaseDetection / cvpods

Star

All-in-one Toolbox for Computer Vision Research.

research computer-vision detection pytorch classification segmentation keypoints 3d self-supervised-learning cvpods

Updated Jan 7, 2022
Python

fangchangma / self-supervised-depth-completion

Star

ICRA 2019 "Self-supervised Sparse-to-Dense: Self-supervised Depth Completion from LiDAR and Monocular Camera"

computer-vision deep-learning pytorch lidar kitti-dataset depth-estimation depth-prediction self-supervised-learning depth-completion

Updated Apr 24, 2021
Python

mkocabas / EpipolarPose

Star

Self-Supervised Learning of 3D Human Pose using Multi-view Geometry (CVPR2019)

machine-learning computer-vision pytorch human-pose-estimation cvpr 3d-pose-estimation self-supervised-learning cvpr-2019 cvpr2019 cvpr19

Updated Jun 26, 2019
Jupyter Notebook

dev-sungman / Awesome-Self-Supervised-Papers

Star

Paper bank for Self-Supervised Learning

awesome sota self-supervised self-supervised-learning cvpr2020

Updated Sep 26, 2021

dipy / dipy

Star

DIPY is the paragon 3D/4D+ imaging library in Python. Contains generic methods for spatial normalization, signal processing, machine learning, statistical analysis and visualization of medical images. Additionally, it contains specialized methods for computational anatomy including diffusion, perfusion and structural imaging.