Awesome List Updates on May 14, 2024

9 awesome lists updated today.

🏠 Home · 🔍 Search · 🔥 Feed · 📮 Subscribe · ❤️ Sponsor

1. Awesome Storybook

Examples

• Recharts

2. Awesome Azure Openai Llm

Prompt Engineering / Prompt Template Language

• Claude Prompt Engineer (⭐8.2k): Simply input a description of your task and some test cases, and the system will generate, test, and rank a multitude of prompts to find the ones that perform the best. [4 Jul 2023] / Anthropic Helper metaprompt ref

OpenAI's Roadmap and Products / GPT series release date

• GPT-4o: o stands for Omni. 50% cheaper. 2x faster. Multimodal input and output capabilities (text, audio, vision). supports 50 languages. [13 May 2024]

Evaluation Benchmark / OSS Alternatives for OpenAI Code Interpreter (aka. Advanced Data Analytics)

• Artificial Analysis LLM Performance Leaderboard: Performance benchmarks & pricing across API providers of LLMs

Evaluation metrics / OSS Alternatives for OpenAI Code Interpreter (aka. Advanced Data Analytics)

• Automated evaluation of LLMs

• n-gram based metrics: Evaluates the model using n-gram statistics and F1 score. ROUGE, BLEU, and METEOR are used for summarization and translation tasks.

• Probabilistic model evaluation metrics: Evaluates the model using the predictive performance of probability models. Perplexity.

• Embedding based metrics: Evaluates the model using semantic similarity of embeddings. Ada Similarity and BERTScore are used.

  Expand

  • ROUGE (Recall-Oriented Understudy for Gisting Evaluation): The metrics compare an automatically produced summary or translation against a reference or a set of references (human-produced) summary or translation. It includes several measures such as:

    1. ROUGE-N: Overlap of n-grams between the system and reference summaries.
    2. ROUGE-L: Longest Common Subsequence (LCS) based statistics.
    3. ROUGE-W: Weighted LCS-based statistics that favor consecutive LCSes.
    4. ROUGE-S: Skip-bigram based co-occurrence statistics.
    5. ROUGE-SU: Skip-bigram plus unigram-based co-occurrence statistics1.

  • n-gram: An n-gram is a contiguous sequence of n items from a given sample of text or speech. For example, in the sentence “I love AI”, the unigrams (1-gram) are “I”, “love”, “AI”; the bigrams (2-gram) are “I love”, “love AI”; and the trigram (3-gram) is “I love AI”.

  • BLEU: BLEU’s output is always a number between 0 and 1. An algorithm for evaluating the quality of machine-translated text. The closer a machine translation is to a professional human translation, the better it is.

  • BERTScore: A metric that leverages pre-trained contextual embeddings from BERT for text generation tasks. It combines precision and recall values.

  • Perplexity: A measure of a model's predictive performance, with lower values indicating better prediction.

  • METEOR: An n-gram based metric for machine translation, considering precision, recall, and semantic similarity.

• Human evaluation of LLMs (possibly Automate by LLM-based metrics): Evaluate the model’s performance on NLU and NLG tasks. It includes evaluations of relevance, fluency, coherence, and groundedness.

• Built-in evaluation methods in Prompt flow: ref [Aug 2023] / ref

LLMOps: Large Language Model Operations / OSS Alternatives for OpenAI Code Interpreter (aka. Advanced Data Analytics)

• Prompt flow: A set of LLMOps tools designed to facilitate the creation of LLM-based AI applications [Sep 2023]

3. Awesome Rust

Applications / Audio and Music

• Pinepods (⭐165) - A rust based podcast management system with multi-user support. Pinepods utilizes a central database so aspects like listen time and themes follow from device to device. With clients built using Tauri, it's a full cross-platform listening solution!

4. Awesome Magento2

Tools

• Mage Wizard (⭐11) - Local web UI to view and create automatically modules, plugins, configs, observers, commands, crontabs, etc. directly in Magento 2 codebase

5. Awesome Playcanvas

Browser Games

• Virtual Voodoo - Voodoo doll simulator.

6. Awesome Godot

Templates / Godot 4.2+

• Maaack's Game Template (⭐218) - Template with a main menu, options menus, pause menu, credits, scene loader, extra tools, and an example game scene.

Plugins and scripts / Godot 4.2+

• Maaack's Game Template Plugin (⭐218) - Template with a main menu, options menus, pause menu, credits, scene loader, extra tools, and an example game scene.

• Maaack's Menus Template (⭐61) - Template with a main menu, options menus, credits, and a scene loader.

• Maaack's Scene Loader (⭐8) - Scene loader that includes a loading screen, progress bar, and error handling.

7. Awesome Vue

Projects Using Vue.js / Open Source

• YesPlayMusic (⭐27k) - High-looking third-party NetEase cloud player, support Windows / macOS / Linux :electron:

Components & Libraries / Frameworks

• gin-vue-admin (⭐20k) - 🚀Vite+Vue3+Gin development basic platform. Live demo

Components & Libraries / UI Components

• vue-echarts (⭐9.3k) - Vue.js component for Apache ECharts™.

Components & Libraries / UI Utilities

• unplugin-vue-router (⭐1.3k) - Next Generation file based typed routing for Vue Router.

• vue-starport (⭐1.8k) 🛰 Shared component across routes with animations

Components & Libraries / Scaffold

• vue-x-platforms (⭐15) - Vue running on Web, iOS, Android and Vision Pro.

8. Awesome Angular

Material Based / Google Developer Experts

• Angular Material - Material Design components for Angular.

9. Awesome Tmux

Tools and session management

• tome (⭐26) 🔁 Playbooks for tmux & vim, replacing your shell history

• Prev: May 15, 2024
• Next: May 13, 2024