A week in Openverse: 2024-04-15 – 2024-04-22


openverse

Merged PRs

API

  • #4077: Add (or update) robots.txt and ai.txt to block AI crawlers
  • #4085: Show the unstable params and improve collection docs
  • #4120: Publish changelog for api-2024.04.15.17.18.29
  • #4123: Bump sqlparse from 0.4.4 to 0.5.0 in /api
  • #4128: Add implementation plan for new Python package manager PDM

Catalog

  • #4083: Add instructions how to run ingestion script from command line
  • #4093: Fix date range sent to Slack from reingestion workflows
  • #4102: Fill out query params for Stocksnap DAG, allow restarts
  • #4104: Wait for iNaturalist load completion before compiling statistics
  • #4105: Update Science Museum ingester with API changes
  • #4159: Update dependency apache-airflow to v2.9.0, Python to 3.12
  • #4161: Publish changelog for catalog-2024.04.18.23.30.21

Documentation

  • #4077: Add (or update) robots.txt and ai.txt to block AI crawlers
  • #4089: Add useful Log Insights query to Nuxt avg response time runbook
  • #4128: Add implementation plan for new Python package manager PDM
  • #4162: Add horizontal lines to DAG doc for better visual separation

Frontend

  • #4077: Add (or update) robots.txt and ai.txt to block AI crawlers
  • #4099: Add a redirect on 503 to frontend nginx
  • #4112: Publish changelog for frontend-2024.04.13.16.19.50
  • #4116: Fix the back to results button for pages opened from collection pages
  • #4117: Set additional search views to enabled
  • #4118: Publish changelog for frontend-2024.04.15.15.20.23
  • #4129: Update dependency prettier-plugin-tailwindcss to v0.5.14
  • #4130: Update dependency typescript to v5.4.5
  • #4131: Update pnpm to v8.15.7
  • #4132: Update dependency @nuxtjs/composition-api to ^0.34.0
  • #4133: Update dependency @playwright/test to v1.43.1
  • #4136: Update dependency rimraf to v5

Ingestion Server

  • #4140: Bump gunicorn from 21.2.0 to 22.0.0 in /ingestion_server
  • #4160: Publish changelog for ingestion_server-2024.04.18.16.49.08

Management

  • #4114: Break `docker-compose.yml` into smaller `compose.yml` files
  • #4170: Remove unnecessary params from healthcheck
  • #4171: Always remove containers when using `just run`

Closed issues

API

  • #286: Implementation Plan: Switch Python package management away from Pipenv
  • #687: Prevent divergent migrations from being merged by concurrent, not-rebased PRs
  • #3634: Add content moderator user preferences admin view
  • #4005: Set cache control header on API responses
  • #4080: Show unstable parameters in the API documentation, adding a disclaimer about why they are unstable
  • #4081: Add `unstable__` prefix to the additional search views `collection` parameter

Catalog

  • #737: Unify environment names
  • #1379: Aggregate ingestion errors over reingestion
  • #1404: Report data refresh count change by provider
  • #2799: Add instructions for running ingestion via the CLI
  • #3964: Reingestion workflows report misleading date range to Slack
  • #3981: Implementation Plan for Ingestion Server removal
  • #4092: Update Science Museum DAG to use new API response format
  • #4103: Investigate recent iNaturalist failures

Documentation

  • #3207: Do not produce reingestion workflow documentation if it matches regular workflow documentation

Frontend

  • #2996: Handle Plausible outages
  • #3473: Proxy frontend API requests through Nuxt
  • #3900: robots.txt for AI-related crawlers and bots
  • #3959: Dark Mode Design Proposal
  • #4115: Single result pages opened from collection views do not have “Back to results” link

Ingestion Server

  • #286: Implementation Plan: Switch Python package management away from Pipenv
  • #3981: Implementation Plan for Ingestion Server removal

Management

  • #286: Implementation Plan: Switch Python package management away from Pipenv
  • #4111: Break down `docker-compose.yml` into smaller more-maintainable chunks

openverse-infrastructure

Merged PRs

Catalog

  • #854: Bump catalog to rel-2024.04.18.23.30.21

Infra

  • #833: Import existing openverse.org Cloudflare rulesets and bring over API and Airflow rules from .engineering zone
  • #848: Remove legacy deployment environment from Airflow compose

Ingestion Server

  • #852: Bump ing server to rel-2024.04.18

Closed issues

Infra

  • #777: Add API domains for `openverse.org` to Cloudflare access and port all API `openverse.engineering` rules to `openverse.org`

#openverse, #week-in-openverse