Article: Weaviate is an open-source search engine powered by ML, vectors, graphs, and GraphQL

Free, Open Software, Open Source

Weaviate is an open-source search engine powered by ML, vectors, graphs, and GraphQL

Bob van Luijt’s career in technology started at age 15, building websites to help people sell toothbrushes online. Not many 15 year-olds do that. Apparently, this gave van Luijt enough of a head start to arrive at the confluence of technology trends today.

Van Luijt went on to study arts but ended up working full time in technology anyway. In 2015, when Google introduced its RankBrain algorithm, the quality of search results jumped up. It was a watershed moment, as it introduced machine learning in search. A few people noticed, including van Luijt, who saw a business opportunity and decided to bring this to the masses.

Read Full Article

Article: GPT-Neo: The Open-Source Cure For GPT-3 FOMO

Code, Open Software, Open Source

GPT-Neo: The Open-Source Cure For GPT-3 FOMO

GPT-3 was the largest language model when OpenAI released it last year. Now, Google Brain’s 1.6 trillion parameters language model (as opposed to GPT-3’s 175 billion parameters) has replaced GPT-3 as the largest language model. Both GPT-3 and Google Brain model are transformer-based neural networks.

Developers across the world were waiting for the arrival of GPT-3 with bated breath. But much to their disappointment, and a departure from their earlier signals, OpenAI exclusively sold the source code of GPT-3 to Microsoft. Interestingly, GPT and GPT-2 were open-source projects.

Read Full Article

Article: Learning how to learn is the future of higher education

Open Software, Open Source

Learning how to learn is the future of higher education

The internet makes world-class education available to anyone with a connected device these days, particularly if you want to study technology.
From Harvard’s Introduction to Computer Science to Coursera’s Advanced Computer Vision with TensorFlow, free course offerings run the gamut from beginner to expert.

But where to begin? Students don’t need more content, they need curation and a framework to guide them through the maze of available courses so that they spend their time wisely, building up useful knowledge that will translate into a career.

Read Full Article

Article: How Open Source is Driving the Future of Data Science

Free, Open Data, Open Software, Open Source

How Open Source is Driving the Future of Data Science

With its reliance on a community of physically dispersed individuals and flexibility of adoption, open-source data science is becoming an even more attractive choice among cash-strapped governments, non-profits, and businesses.

Over the past decade, data science and machine learning have made their way from an obscure academic discipline to widespread corporate adoption. The academic community has a natural preference towards open source. Science is a collaborative effort, and its advancement is best served by enabling as large a community as possible to build upon existing research.

Read Full Article

Article: New Open Source Index: VS Code Is No. 1 Code Editor

Free, Libre, Open Software, Open Source

New Open Source Index: VS Code Is No. 1 Code Editor

Confirming many other studies, trackers and surveys, a new open source project tracker lists Microsoft’s Visual Studio Code as the top code editor, clocking in at No. 11 on the list of most popular and fastest-growing GitHub projects.

This ranking comes from Two Sigma Ventures, which launched the new Open Source Index last week. Right now (March 31), the index shows the TensorFlow machine learning framework at the top. In addition to VS Code at No. 11, other notable products from Microsoft — which has made much of its 180-degree turnabout embrace of open source years ago — include TypeScript (No. 15); ASP.NET Core (No. 24); and PowerShell (No. 40).

Read Full Article

Article: Guide to Open3D: An Open Source Modern Library For 3D Data Processing

Code, Free, Open Software

Guide to Open3D: An Open Source Modern Library For 3D Data Processing

Open3D is an open-source library designed for processing 3D data. It was introduced by Qian-Yi Zhou, Jaesik Park and Vladlen Koltun – researchers at Intel Labs (research paper).

Its backend enables parallelization while the frontend exposes several useful algorithms and data structures of C++ and Python programming languages. With a small set of dependencies, it requires little effort for compiling Open3D code from source and setting it up on various platforms.

Read Full Article

Article: The Open Source Index showcases GitHub’s most popular projects right now

Code, Free, Libre, Open Software, Open Source

The Open Source Index showcases GitHub’s most popular projects right now

It intersects with just about every piece of software, from systems architecture to APIs, and enterprises are adopting it more than ever. Open source software, judging by just about every estimation in recent years, is eating the world.

But sifting through the vast array of open source projects out there, sorting the wheat from the chaff, can be a challenge, which is partly why early stage VC firm Two Sigma Ventures has launched a new index designed to surface “high-level trends” in the open source sphere.

Read Full Article

Article: Amazon AWS, Hugging Face team up to spread open-source deep learning

Code, Free, Open Software

Amazon AWS, Hugging Face team up to spread open-source deep learning

Two years ago, the New York-based startup Hugging Face burst onto the natural language processing scene with a way to let many more parties participate in state-of-the art deep learning. Transformers, a programming kit to quickly grab any of a number of natural language neural networks, including Google’s BERT, was posted as a library to be invoked from the dominant programming frameworks, PyTorch and TensorFlow.

It has grown and grown in popularity. More than 5,000 organizations are now using the library, the company says. The popularity of that toolkit has been recognized by Amazon AWS, the world’s biggest clouding computing provider, and the two companies Tuesday announced a partnership to combine Transformers with the best aspects of Amazon AWS’s programming tools.

Read Full Article

Article: Is TensorFlow ‘for Boomers’? PyTorch May Gain More Ground in Machine Translation

Free, Libre, Open Software, Open Source

Is TensorFlow ‘for Boomers’? PyTorch May Gain More Ground in Machine Translation

PyTorch, the open source framework used to build machine learning models, including those used for machine translation, released its newest version, 1.8, on March 4, 2021.

According to PyTorch’s official announcement, “highlights include updates for compiler, code optimization, frontend APIs for scientific computing, large scale training for pipeline and model parallelism, and Mobile tutorials.” Prior to this release, PyTorch released version 1.7 in October 2020.

Read Full Article

Article: Google Open-Sources AutoML Algorithm Model Search

Code, Open Software, Open Source

Google Open-Sources AutoML Algorithm Model Search

A team from Google Research has open-sourced Model Search, an automated machine learning (AutoML) platform for designing deep-learning models. Experimental results show that the system produces models that outperform the best human-designed models, with fewer training iterations and model parameters.

Researchers Hanna Mazzawi and Xavi Gonzalvo described the system in a recent blog post. Model Search is implemented in the TensorFlow deep-learning framework and composes a deep neural network (DNN) from a set of component blocks such as Transformers or long short-term memory (LSTM) layers.

Read Full Article