Awesome List Updates on Nov 14, 2015

17 awesome lists updated today.

🏠 Home · 🔍 Search · 🔥 Feed · 📮 Subscribe · ❤️ Sponsor

1. Awesome Deep Learning

Researchers / Frameworks

• DMTK - Microsoft Distributed Machine Learning Tookit (⭐2.8k)

2. Awesome Bigdata

Distributed Filesystem

• Lustre file system - high-performance distributed filesystem.

Machine Learning

• SAMOA - distributed streaming machine learning framework.

Data Visualization

• Bokeh - A powerful Python interactive visualization library that targets modern web browsers for presentation, with the goal of providing elegant, concise construction of novel graphics in the style of D3.js, but also delivering this capability with high-performance interactivity over very large or streaming datasets.

2001 - 2010

• 2010 - Yahoo - S4: Distributed Stream Computing Platform.

3. Awesome Hadoop

Hadoop

• Elasticsearch Hadoop (⭐1.9k) - Elasticsearch real-time search and analytics natively integrated with Hadoop. Supports Map/Reduce, Cascading, Apache Hive and Apache Pig.

• Apache Ignite - Distributed in-memory platform

YARN

• mpich2-yarn (⭐110) - Running MPICH2 on Yarn

SQL on Hadoop

• Presto - Distributed SQL Query Engine for Big Data. Open sourced by Facebook.

Data Management

• Apache Calcite - A Dynamic Data Management Framework

Workflow, Lifecycle and Governance

• Apache Falcon - Data management and processing platform

• Apache NiFi - A dataflow system

DSL

• vahara (⭐51) - Machine learning and natural language processing with Apache Pig

Libraries and Tools

• Elephant Bird (⭐1.1k) - Twitter's collection of LZO and Protocol Buffer-related Hadoop, Pig, Hive, and HBase code.

Realtime Data Processing

• Apache Storm

• Apache Samza

Distributed Computing and Programming

• SparkHub - A community site for Apache Spark

• Apache Flink - Apache Flink is a platform for efficient, distributed, general-purpose data processing.

Search

• ElasticSearch

Machine learning and Big Data analytics

• Apache Lens

4. Papers We Love

Info / Other Good Places to Find Papers

• MIT's Distributed System's Reading Group

5. Sublime Bookmarks

Things to Start From

• Package Control — the first thing to do after the ST installation is to setup the package manager.

Community

• Sublime Reddit — user-generated news links and discussions.

Screencasts

• The Complete Visual Guide to Sublime Text 3: Getting Started and Keyboard Shortcuts (free course).

• Sublime Text 2 by Mike Riley (Pragmatic Studio).

Extensions / Ruby Profile

• Sublime Text setup (⭐718) used in the Ruby on Rails Tutorial

Extensions / Python Profile

• Setting up Sublime Text for Python development

Extensions / Documentation and Help Systems

• DashDoc (⭐1.3k) — Dash integration for Sublime Text.

Integration / Documentation and Help Systems

• Associating text editors with Git

Fun stuff / Monospace Fonts

• Adobe Source Code Pro (⭐19k)

• Monaco

• What are the best programming fonts?

6. Awesome Jquery

Time and Date / Paid Books

• Timeago (⭐3.8k) - Easy support of automatic updating fuzzy timestamps (e.g. "4 minutes ago").

7. Awesome Haskell

Algorithmics

• Algorithm - a collaborative Hackage list.

• Algorithms - a collaborative Hackage list.

• Compression - a collaborative Hackage list.

• Logic - a collaborative Hackage list.

• Map Reduce - a collaborative Hackage list.

• Graphs - a collaborative Hackage list.

• Optimization - a collaborative Hackage list.

• Simulation - a collaborative Hackage list.

• SMT - a collaborative Hackage list for Satisfiability Modulo Theories (SMT).

Audio, Music & Sound

• Audio - a collaborative Hackage list.

• Codec - a collaborative Hackage list.

• Media - a collaborative Hackage list.

• Music - a collaborative Hackage list.

• Sound - a collaborative Hackage list.

Graphics

• Graphics - a collaborative Hackage list.

Category Theory

• Adjunctions - a collaborative Hackage list.

• Algebra - a collaborative Hackage list.

• Categories - a collaborative Hackage list.

• Combinators - a collaborative Hackage list.

• Comonads - a collaborative Hackage list.

• Constraints - a collaborative Hackage list.

• Functors - a collaborative Hackage list.

• Monad - a collaborative Hackage list.

• Monads - a collaborative Hackage list.

• Semigroups - a collaborative Hackage list.

Compilers

• Compiler - a collaborative Hackage list.

• Compilers/Interpreters - a collaborative Hackage list.

Concurrency & Parallelism

• Concurrency - a collaborative Hackage list.

• Concurrent - a collaborative Hackage list.

• Functional Reactive Programming - a collaborative Hackage list.

Cryptography & Hashing

• Crypto - a collaborative Hackage list.

• Cryptography - a collaborative Hackage list.

Data Formats

• JSON - a collaborative Hackage list.

• PDF - a collaborative Hackage list.

• XML - a collaborative Hackage list.

• RSS - a collaborative Hackage list.

Data Science

• Artificial Intelligence - a collaborative Hackage list.

• Argumentations - a collaborative Hackage list.

• Classification - a collaborative Hackage list.

• Clustering - a collaborative Hackage list.

• Datamining - a collaborative Hackage list.

• Search - a collaborative Hackage list.

• Statistics - a collaborative Hackage list.

Data Structures

• Advanced Structures - a collaborative Hackage list.

• Containers - a collaborative Hackage list.

• Enumerator - a collaborative Hackage list.

• Generics - a collaborative Hackage list.

• List - a collaborative Hackage list.

• Tree - a collaborative Hackage list.

• Vector - a collaborative Hackage list.

Database

• Database - a collaborative Hackage list.

Development Tools

• Debug - a collaborative Hackage list.

• IDE - a collaborative Hackage list.

• Test - a collaborative Hackage list.

• Testing - a collaborative Hackage list.

• Logging - a collaborative Hackage list.

• Monitoring - a collaborative Hackage list.

Documentation

• Documentation - a collaborative Hackage list.

Games

• Game - a collaborative Hackage list.

GUI

• GUI - a collaborative Hackage list.

Network

• Network - a collaborative Hackage list.

Number Theory

• Numeric - a collaborative Hackage list.

• Numerical - a collaborative Hackage list.

• Math - a collaborative Hackage list.

Messaging

• IRC - a collaborative Hackage list for Internet Relay Chat (IRC).

• [IRC Client](http://hackage.haskell.org/packages/#cat:IRC Client) - a collaborative Hackage list.

Languages

• FFI - a collaborative Hackage list.

• HTML - a collaborative Hackage list.

• Java - a collaborative Hackage list.

• Javascript - a collaborative Hackage list.

• LaTex - a collaborative Hackage list.

Operating Systems

• BSD - a collaborative Hackage list.

• Fedora - a collaborative Hackage list.

• Gentoo - a collaborative Hackage list.

• Linux - a collaborative Hackage list.

• System - a collaborative Hackage list.

Platforms

• .NET - a collaborative Hackage list.

• Apple - a collaborative Hackage list.

• JVM - a collaborative Hackage list.

• Mobile - a collaborative Hackage list.

Programming

• Generic Programming - a collaborative Hackage list.

• Logic Programming - a collaborative Hackage list.

• Reactive Programming - a collaborative Hackage list.

Science

• Chemistry - a collaborative Hackage list.

• Bioinformatics - a collaborative Hackage list.

• Finance - a collaborative Hackage list.

• Physics - a collaborative Hackage list.

• Science - a collaborative Hackage list.

Streaming Processing

• IO-Streams - a collaborative Hackage list.

8. Awesome Geek Podcasts

In English

• CodePen Radio - Co-founders of CodePen talk about the ins and outs of running a web software business.

• DevChat.tv - We are programmers. House of Ruby Rogues, Javascript Jabber, IPhreaks, Freelancers' Show, Adventures in Angular and RailsClips.

• Full Stack Radio - A podcast for developers interested in building great software products.

9. Awesome Workshopper

Raw Builders

• Project Name: Workshopper rvagg/workshopper (⭐1.1k)

Workshoppers

• Module Name: goingnative (⭐402)

  Description: Learn how to write native Node.js addons

• Module Name: learnyounode (⭐7.1k)

  Description: Learn You The Node.js For Much Win! An intro to Node.js

• Module Name: levelmeup (⭐268)

  Description: Level Me Up Scotty! An intro to Node.js databases

10. Awesome Security

Network / Scanning / Pentesting

• Kali - Kali Linux is a Debian-derived Linux distribution designed for digital forensics and penetration testing. Kali Linux is preinstalled with numerous penetration-testing programs, including nmap (a port scanner), Wireshark (a packet analyzer), John the Ripper (a password cracker), and Aircrack-ng (a software suite for penetration-testing wireless LANs).

Network / Monitoring / Logging

• ntopng - Ntopng is a network traffic probe that shows the network usage, similar to what the popular top Unix command does.

Network / Honey Pot / Honey Net

• HonSSH (⭐366) - HonSSH is a high-interaction Honey Pot solution. HonSSH will sit between an attacker and a honey pot, creating two separate SSH connections between them.

Network / Full Packet Capture / Forensic

• Moloch (⭐5.9k) - Moloch is an open source, large scale IPv4 packet capturing (PCAP), indexing and database system. A simple web interface is provided for PCAP browsing, searching, and exporting. APIs are exposed that allow PCAP data and JSON-formatted session data to be downloaded directly. Simple security is implemented by using HTTPS and HTTP digest password support or by using apache in front. Moloch is not meant to replace IDS engines but instead work along side them to store and index all the network traffic in standard PCAP format, providing fast access. Moloch is built to be deployed across many systems and can scale to handle multiple gigabits/sec of traffic.

Network / VPN

• OpenVPN - OpenVPN is an open source software application that implements virtual private network (VPN) techniques for creating secure point-to-point or site-to-site connections in routed or bridged configurations and remote access facilities. It uses a custom security protocol that utilizes SSL/TLS for key exchange.

Endpoint / Authentication

• google-authenticator (⭐5.1k) - The Google Authenticator project includes implementations of one-time passcode generators for several mobile platforms, as well as a pluggable authentication module (PAM). One-time passcodes are generated using open standards developed by the Initiative for Open Authentication (OATH) (which is unrelated to OAuth). These implementations support the HMAC-Based One-time Password (HOTP) algorithm specified in RFC 4226 and the Time-based One-time Password (TOTP) algorithm specified in RFC 6238. Tutorials: How to set up two-factor authentication for SSH login on Linux

11. Awesome Malware Analysis

Malware Collection / Honeypots

• Conpot (⭐1k) - ICS/SCADA honeypot.

Detection and Classification / Other Resources

• ClamAV - Open source antivirus engine.

Online Scanners and Sandboxes / Other Resources

• DeepViz - Multi-format file analyzer with machine-learning classification.

• Jotti - Free online multi-AV scanner.

12. Awesome Hacking

General

• Exploit database - An ultimate archive of exploits and vulnerable software

Tools / Other

• nmap - Nmap (Network Mapper) is a security scanner

Web / Other

• 0xf.at - a website without logins or ads where you can solve password-riddles (so called hackits).

Competition / Other

• PHD CTF

General / Other

• CTF archives (shell-storm)

13. Awesome Json

Command-line tools

• json - A "json" command for massaging JSON on your Unix command line.

Datasets

• Heartstone JSON - Up to date Hearthstone card data.

Frontend components

• jsTree - jquery plugin, that provides interactive trees. (jQuery)

Libraries

• Gson (⭐23k) - A Java library to convert JSON to Java objects and vice-versa.

JSON Schema Tools

• JSON Schema + Faker (⭐3.2k) - Fake your schemas.

14. Awesome Rest

Node.js

• node-restify (⭐11k) - Framework specifically meant for REST API.

PHP / Symfony2

• API Platform (⭐8k) - Specialize Symfony edition for the creation of hypermedia REST APIs.

Querying / Symfony2

• httpie (⭐29k) - Command line HTTP client, far more dev-friendly than curl.

15. Awesome Ciandcd

Theory

• software integration

• ci cheatsheet

Build And Release System

• BuildForge Automate and accelerate build and release processes

• VisualBuild Visual Build enables developers and build masters to easily create an automated, repeatable build process

• rexify perl Deployment & Configuration Management

Online Build System

• cloudbees the Enterprise Jenkins Company

• shippable Hosted continuous integration and deployment service built on docker

• buildbox Simple self-hosted Continuous Integration

• GitLab CI - Based off of ruby. They also provide GitLab, which manages git repositories.

Infrastructure

• LSF Platform Load Sharing Facility (or simply LSF) is a workload management platform, job scheduler, for distributed HPC environments. It can be used to execute batch jobs on networked Unix and Windows systems on many different architectures

• amazon Scalable, pay-as-you-go compute capacity in the cloud

Source Code Management

• perforce Industry’s most reliable and proven platform for versioning code, images, documents... everything

• mercurial Mercurial is a free, distributed source control management tool. It efficiently handles projects of any size and offers an easy and intuitive interface

• gitlab Open source self-hosted Git management software

Code Review

• codecollaborator Collaborator helps development, testing and management teams work together to produce high quality code

• crucible Code reviews = quality code. Review code, discuss changes, share knowledge, and identify defects with Crucible's flexible review workflow. It's code review made easy for Subversion, CVS, Perforce, and more

• reviewboard Review Board takes the pain out of code review, saving you time, money, and sanity so you can focus on making great software

• gerrit Gerrit is a web based code review system, facilitating online code reviews for projects using the Git version control system

Build

• gnumake GNU Make is a tool which controls the generation of executables and other non-source files of a program from the program's source files

• gnuautoconf Autoconf is an extensible package of M4 macros that produce shell scripts to automatically configure software source code packages

• cmake cmake offers robust, cross-platform software development solutions. Find out how we can help your team efficiently manage the build, test, and package process for your software project

• gradle Gradle is build automation evolved. Gradle can automate the building, testing, publishing, deployment and more of software packages or other types of projects such as generated static websites, generated documentation or indeed anything else.

Static Check

• static tools wiki wiki page

Dynamic Check

• dynamic tools wiki wiki page

Performance Analysis

• performance tools wiki wiki page

Coverage

• code coverage wiki wiki page

Testing

• Testingautomation test automation wiki page

Package

• NSIS NSIS (Nullsoft Scriptable Install System) is a professional open source system to create Windows installers. It is designed to be as small and flexible as possible and is therefore very suitable for internet distribution

Deploy

• jfrog s the first Binary Repository Management solution, Artifactory has changed the way binaries are controlled, stored and managed throughout the software release cycle

• xl-deploy Agentless, Model-based App Deployment

Delivery

• sl-release Orchestrate your Continuous Delivery pipelines. Simple. Flexible. End-to-End

Provisioning Tools

• Chef Fast, scalable and flexible software for data center automation

OS And Shell

• awesome-perl (⭐620)

Applications And Container

• suseapplication tools to create suse applications

16. Awesome Typescript

Awesome TypeScript Essential Resources

• 📚 TypeScript Deep Dive by Basarat Ali Syed

17. Awesome Stock Resources

Paid Resources / Icons Packages and Collections

• Inky Deals - Premium resources at insane discounts.

• Prev: Nov 15, 2015
• Next: Nov 13, 2015