the commonplace notebook for eliana

ideas

3 min read

Google Search Queries

  • npmjs alternative registry
  • npmjs alternative registry site:stackoverflow.com
  • npmjs alternative registry site:www.reddit.com
  • Free private npm registry
  • Local npm registry
  • Npm proxy registry
  • Npmjs alternative registry github
  • Private npm registry
  • Private npm registry self hosted
  • Self-hosted npm registry
  • Verdaccio npm

CDN / Static Hosting Services

1. Alternative npm Search Engines / Explorers

2. Alternative / Mirror npm Registries (Hosted)

3. Self-Hosted / Private Registry Servers

Projects (GitHub)

Corresponding npm Packages

4. Hosted SaaS / Artifact Services

5. Discussion / Q&A

Stack Overflow

Reddit

Other Forums

6. Profiles & Articles

7. Script: Parse Search URLs (Node.js Plan)

Steps to build a script that reads a text file of search URLs and extracts the query string:

  1. Prepare input — one URL per line in urls.txt
  2. Decide fields to extract — q param, start (page offset), udm (UI mode), site: scopes
  3. Initialize project — npm init -y, create parse-urls.mjs
  4. Read the file — fs.readFileSync('urls.txt', 'utf8').split('\n'), trim lines, skip blanks/# comments
  5. Parse each URL — use new URL(line) (Node 18+); access u.searchParams.get('q') etc.
  6. Detect engine — if u.host ends with google.com and u.pathname === '/search', treat as Google
  7. Normalize the query — trim, normalize whitespace, detect embedded site: operators
  8. Output results — one JSON object per URL: { url, engine, query, pageOffset, udm }
  9. Handle duplicates/errors — use a Set for deduplication; wrap in try/catch
  10. Generalize — abstract into parseUrl(line) dispatching to parseGoogle, parseBing, etc.
// parse-urls.mjs
import { readFileSync } from 'fs';
 
const lines = readFileSync('urls.txt', 'utf8')
  .split('\n')
  .map(l => l.trim())
  .filter(l => l && !l.startsWith('#'));
 
const seen = new Set();
 
for (const line of lines) {
  try {
    const u = new URL(line);
    if (u.host.endsWith('google.com') && u.pathname === '/search') {
      const query = u.searchParams.get('q') || '';
      const start = u.searchParams.get('start') || '0';
      const udm   = u.searchParams.get('udm') || '';
      const key   = `${query}|${start}|${udm}`;
      if (seen.has(key)) continue;
      seen.add(key);
      console.log(JSON.stringify({ engine: 'google', query, pageOffset: Number(start), udm, url: line }));
    }
  } catch (e) {
    console.error('Skipping malformed URL:', line);
  }
}

Graph View