Monday, February 20, 2017

Thesis: Sparse Grids for Big Data: Exploiting Parsimony for Large-Scale Learning by Valeriy Khakhutskyy

Congratulations Dr. Khakhutskyy !
 


Sparse Grids for Big Data: Exploiting Parsimony for Large-Scale Learning by Valeriy Khakhutskyy
High-dimensional data analysis becomes ubiquitous in both science and industry. An important tool for data analysis is supervised learning with non-parametric models, which estimates the dependency between target and input variables without imposing explicit assumptions on the data. This generality, however, comes at a price of computational costs that grow exponentially with the dimensionality of the input. In general, nonparametric models cannot evade this curse of dimensionality unless the problem exhibits certain properties. Hence, to facilitate large-scale supervised learning, this thesis focuses on two such properties: the existence of a low-dimensional manifold in the data and the discounting importance of high-order interactions between input variables. Often a problem would exhibit both these properties to a certain degree. To identify and exploit these properties, this work extends the notion of parsimony for hierarchical sparse grid models. It develops learning algorithms that simultaneously optimise the model parameters and the model structure to befit the problem at hand.
The new algorithms for adaptive sparse grids increase the range of computationally feasible supervised learning problems. They decrease the computation costs for training sparse grid models and the memory footprint of the resulting models. Hence, the algorithms can be used for classification and regression on high-dimensional data. Furthermore, they improve the interpretability of the sparse grid model and are suitable for learning the structure of the underlying
data distribution.

 
 
 
Join the CompressiveSensing subreddit or the Google+ Community or the Facebook page and post there !
Liked this entry ? subscribe to Nuit Blanche's feed, there's more where that came from. You can also subscribe to Nuit Blanche by Email, explore the Big Picture in Compressive Sensing or the Matrix Factorization Jungle and join the conversations on compressive sensing, advanced matrix factorization and calibration issues on Linkedin.

Friday, February 17, 2017

ICLR 2017 workshop track open review



The list of accepted and rejected papers as well as papers invited to the ICLR 2017 workshop track is now here

Deadline submission for the ICLR workshop track is today at 5PM EST. The current stack of submission is as follows: 
Online Multi-Task Learning Using Biased SamplingSahil Sharma, Balaraman Ravindran17 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesAdapting Distance Kernel to Domain adaptation for sentimental analysis Saerom Park, Jaewook Lee, Woojin Lee17 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
On Improving the Numerical Stability of Winograd Convolutions
Kevin Vincent, Kevin Stephano, Michael Frumkin, Boris Ginsburg, Julien Demouth
17 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Fast Generation for Convolutional Autoregressive Models
Prajit Ramachandran, Tom Le Paine, Pooya Khorrami, Mohammad Babaeizadeh, Shiyu Chang, Yang Zhang, Mark A. Hasegawa-Johnson, Roy H. Campbell, Thomas S. Huang
17 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Online Structure Learning for Sum-Product Networks with Gaussian Leaves
Wilson Hsu, Agastya Kalra, Pascal Poupart
17 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Similarity preserving compressions of high dimensional sparse data
Raghav Kulkarni, Rameshwar Pratap
17 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Towards an Automatic Turing Test: Learning to Evaluate Dialogue Responses
Ryan Lowe, Michael Noseworthy, Iulian V. Serban, Nicholas Angelard-Gontier, Yoshua Bengio, Joelle Pineau
17 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
A Theoretical Framework for Robustness of (Deep) Classifiers against Adversarial Samples
Beilun Wang, Ji Gao, Yanjun Qi
17 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Factorization tricks for LSTM networks
Oleksii Kuchaiev, Boris Ginsburg
17 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Exploring LOTS in Deep Neural Networks
Andras Rozsa, Manuel Gunther, Terrance E. Boult
17 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Shake-Shake regularization of 3-branch residual networks
Xavier Gastaldi
17 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Trace Norm Regularised Deep Multi-Task Learning
Yongxin Yang, Timothy M. Hospedales
17 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Deep Learning with Sets and Point Clouds
Siamak Ravanbakhsh, Jeff Schneider, Barnabas Poczos
17 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
INCREMENTAL LEARNING WITH PRE-TRAINED CONVOLUTIONAL NEURAL NETWORKS AND BINARY ASSOCIATIVE MEMORIES
Ghouthi Boukli Hacene, Vincent Gripon, Nicolas Farrugia, Mattieu Arzel, Michel Jezequel
17 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Dataset Augmentation in Feature Space
Terrance DeVries, Graham W. Taylor
17 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesOriginal
ICLR 2017 Conference Invite to Workshop
Evaluating Dimensionality Reduction of 2D Histogram Data from Truck On-board Sensors
Evaldas Vaiciukynas, Matej Ulicny, Sepideh Pashami, Slawomir Nowaczyk
17 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
NEUROGENESIS-INSPIRED DICTIONARY LEARNING: ONLINE MODEL ADAPTION IN A CHANGING WORLD
Sahil Garg, Irina Rish, Guillermo Cecchi, Aurelie Lozano
16 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesOriginal
Class-based Prediction Errors to Categorize Text with Out-of-vocabulary Words
Joan Serrà, Ilias Leontiadis, Dimitris Spathis, Gianluca Stringhini, Jeremy Blackburn
16 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Delving Into Adversarial Attacks on Deep Policies
Jernej Kos, Dawn Song
16 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Annealed Generative Adversarial Networks
Arash Mehrjou, Saeed Saremi
16 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Learning a Metric for Relational Data
Jiajun Pan, Hoel Le Capitaine, Philippe Leray
16 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
The High-Dimensional Geometry of Binary Neural Networks
Alexander G. Anderson, Cory P. Berg
16 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Discovering objects and their relations from entangled scene representations
D. Raposo, A. Santoro, D.G.T. Barrett, R. Pascanu, T. Lillicrap, P. Battaglia
16 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesOriginal
ICLR 2017 Conference Invite to Workshop
Multiplicative LSTM for sequence modelling
Ben Krause, Iain Murray, Steve Renals, Liang Lu
16 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesOriginal
ICLR 2017 Conference Invite to Workshop
Learning to Discover Sparse Graphical Models
Eugene Belilovsky, Kyle Kastner, Gael Varoquaux, Matthew B. Blaschko
16 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesOriginal
ICLR 2017 Conference Invite to Workshop
A Differentiable Physics Engine for Deep Learning in Robotics
Jonas Degrave, Michiel Hermans, Joni Dambre, Francis wyffels
16 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesOriginal
ICLR 2017 Conference Invite to Workshop
Revisiting Batch Normalization For Practical Domain Adaptation
Yanghao Li, Naiyan Wang, Jianping Shi, Jiaying Liu, Xiaodi Hou
16 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Coupling Distributed and Symbolic Execution for Natural Language Queries
Lili Mou, Zhengdong Lu, Hang Li, Zhi Jin
16 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Transferring Knowledge to Smaller Network with Class-Distance Loss
Seung Wook Kim, Hyo-Eun Kim
16 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Automated Generation of Multilingual Clusters for the Evaluation of Distributed Representations
Philip Blair, Yuval Merhav, Joel Barry
16 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesOriginal
ICLR 2017 Conference Invite to Workshop
Style Transfer Generative Adversarial Networks: Learning to Play Chess Differently
Muthuraman Chidambaram, Yanjun Qi
16 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Infinite Dimensional Word Embeddings
Eric Nalisnick, Sachin Ravi
15 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Regularizing Neural Networks by Penalizing Confident Output Distributions
Gabriel Pereyra, George Tucker, Jan Chorowski, Lukasz Kaiser, Geoffrey Hinton
15 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesOriginal
Precise Recovery of Latent Vectors from Generative Adversarial Networks
Zachary C. Lipton, Subarna Tripathi
15 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Non-Associative Learning Representation in the Nervous System of the Nematode Caenorhabditis elegans
Ramin M. Hasani, Magdalena Fuchs, Victoria Beneder, Radu Grosu
15 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization
Xun Huang, Serge Belongie
15 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Recurrent Normalization Propagation
César Laurent, Nicolas Ballas, Pascal Vincent
15 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesOriginal
ICLR 2017 Conference Invite to Workshop
Deep Adversarial Gaussian Mixture Auto-Encoder for Clustering
Warith Harchaoui, Pierre-Alexandre Mattei, Charles Bouveyron
15 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Adversarial Examples for Semantic Image Segmentation
Volker Fischer, Mummadi Chaithanya Kumar, Jan Hendrik Metzen, Thomas Brox
15 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
RenderGAN: Generating Realistic Labeled Data
Leon Sixt, Benjamin Wild, Tim Landgraf
15 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesOriginal
ICLR 2017 Conference Invite to Workshop
Tuning Recurrent Neural Networks with Reinforcement Learning
Natasha Jaques, Shixiang Gu, Richard E. Turner, Douglas Eck
14 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesOriginal
ICLR 2017 Conference Invite to Workshop
Generalization to new compositions of known entities in image understanding
Yuval Atzmon, Jonathan Berant, Amir Globerson, Vahid Kazemi, Gal Chechik
14 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Adaptive Feature Abstraction for Translating Video to Language
Yunchen Pu, Martin Renqiang Min, Zhe Gan, Lawrence Carin
14 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesOriginal
ICLR 2017 Conference Invite to Workshop
Generalizable Features From Unsupervised Learning
Mehdi Mirza, Aaron Courville, Yoshua Bengio
14 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesOriginal
ICLR 2017 Conference Invite to Workshop
Neural Style Representations of Fine Art
Jeremiah Johnson
14 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Exploring loss function topology with cyclical learning rates
Leslie N. Smith, Nicholay Topin
14 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Compact Embedding of Binary-coded Inputs and Outputs using Bloom Filters
Joan Serrà, Alexandros Karatzoglou
13 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesOriginal
Perception Updating Networks: On architectural constraints for interpretable video generative models
Decoupled "what" and "where" variational statistical framework and equivalent multi-stream network
12 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesOriginal
ICLR 2017 Conference Invite to Workshop
Semi-supervised deep learning by metric embedding
Elad Hoffer, Nir Ailon
11 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesOriginal
ICLR 2017 Conference Invite to Workshop
REBAR: Low-variance, unbiased gradient estimates for discrete latent variable models
George Tucker, Andriy Mnih, Chris J. Maddison, Jascha Sohl-Dickstein
11 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Adversarial examples in the physical world
Alexey Kurakin, Ian J. Goodfellow, Samy Bengio
11 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesOriginal
ICLR 2017 Conference Invite to Workshop
Variational Reference Priors
Eric Nalisnick, Padhraic Smyth
9 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Development of JavaScript-based deep learning platform and application to distributed training
Masatoshi Hidaka, Ken Miura, Tatsuya Harada
9 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesOriginal
ICLR 2017 Conference Invite to Workshop
Song From PI: A Musically Plausible Network for Pop Music Generation
Hang Chu, Raquel Urtasun, Sanja Fidler
8 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesOriginal
ICLR 2017 Conference Invite to Workshop
Gated Multimodal Units for Information Fusion
John Arevalo, Thamar Solorio, Manuel Montes-y-Gómez, Fabio A. González
8 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesOriginal
ICLR 2017 Conference Invite to Workshop
Adjusting for Dropout Variance in Batch Normalization and Weight Initialization
Dan Hendrycks, Kevin Gimpel
7 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesOriginal
Methods for Detecting Adversarial Images and a Colorful Saliency Map
Dan Hendrycks, Kevin Gimpel
7 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Charged Point Normalization: An Efficient Solution to the Saddle Point Problem
Armen Aghajanyan
7 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesOriginal
ICLR 2017 Conference Invite to Workshop
Compositional Kernel Machines
Robert Gens, Pedro Domingos
7 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 RepliesOriginal
ICLR 2017 Conference Invite to Workshop
DL-gleaning: An approach for Improving inference speed and accuracy
HyunYong Lee and Byung-Tak Lee
6 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Towards "AlphaChem": Chemical Synthesis Planning with Tree Search and Deep Neural Network Policies
Marwin Segler, Mike Preuß, Mark P. Waller
2 Feb 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
CommAI: Evaluating the first steps towards a useful general AI
Marco Baroni, Armand Joulin, Allan Jabri, Germàn Kruszewski, Angeliki Lazaridou, Klemen Simonic, Tomas Mikolov
31 Jan 2017ICLR 2017 workshop submissionreaders: everyone0 Replies
Summarized Behavioral Prediction
Shih-Chieh Su
20 Jan 2017ICLR 2017 workshop submissionreaders: everyone0 Replies



Join the CompressiveSensing subreddit or the Google+ Community or the Facebook page and post there !
Liked this entry ? subscribe to Nuit Blanche's feed, there's more where that came from. You can also subscribe to Nuit Blanche by Email, explore the Big Picture in Compressive Sensing or the Matrix Factorization Jungle and join the conversations on compressive sensing, advanced matrix factorization and calibration issues on Linkedin.

Printfriendly