Skip to content

refactor(gliders): replace BeautifulSoup with stdlib HTMLParser #1278

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
grojeda merged 1 commit into from
Oct 20, 2026
Merged

refactor(gliders): replace BeautifulSoup with stdlib HTMLParser #1278

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 6 additions & 3 deletions ARGO/oceancurrent/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -232,8 +232,8 @@ The source is `/mnt/oceancurrent/website/gliders/index.html`, published at
<https://oceancurrent.aodn.org.au/gliders/index.html>. A search of this repository
and its documented OceanCurrent pipeline found no maintained structured source
for this catalogue. Existing Gliders GIF/MP4 indexes describe assets, not mission
metadata. The parser uses the existing `beautifulsoup4` dependency with Python's
HTML parser; it does not fetch remote resources or inspect scientific files.
metadata. The parser uses Python's standard library `html.parser.HTMLParser`;
it does not fetch remote resources or inspect scientific files.

### JSON schema (version 1)

Expand Down Expand Up @@ -269,7 +269,7 @@ position within a view. These orders may have different lengths.

### Local execution and tests

Use an environment with the repository's `beautifulsoup4` dependency installed.
The generator requires only the Python 3 standard library.
Both paths are required to prevent an accidental production run; the output's
parent directory must already exist. For example, using a local source copy:

Expand All @@ -280,6 +280,9 @@ python3 ARGO/oceancurrent/gliders_catalogue.py \
python3 -m pytest -q ARGO/oceancurrent/test_gliders_catalogue.py
```

The JSON fixture records the previous BeautifulSoup implementation's output; tests
compare both the complete parsed catalogue and generated bytes against it.

The standard library runner is also supported:

```bash
Expand Down
Loading
Loading