AE7Q new license counts #114

Open
opened 2024-02-28 14:16:46 -06:00 by matt · 6 comments

To track new licenses over time, can we scrape the table under "Retrieving license grants issued on"? Note the date in the URL for easy downloading.

https://www.ae7q.com/query/list/ProcessDate.php?DATE=2024-2-02

This goes back to one of the W5YI Report comments that the only way to really measure growth is to measure the number of new hams.

To track new licenses over time, can we scrape the table under "Retrieving license grants issued on"? Note the date in the URL for easy downloading. https://www.ae7q.com/query/list/ProcessDate.php?DATE=2024-2-02 This goes back to one of the W5YI Report comments that the only way to really measure growth is to measure the number of new hams.
Owner

Looks like new license info goes back to 1994-05-24, but renewals and callsign changes aren't being tracked: https://www.ae7q.com/query/list/ProcessDate.php?DATE=1994-05-24

Looks like renewals started being tracked on 1999-08-28: https://www.ae7q.com/query/list/ProcessDate.php?DATE=1999-08-28

Sometime in 2001, vanity callsigns added to that table.

Table structure seems consistent over time.

Looks like new license info goes back to 1994-05-24, but renewals and callsign changes aren't being tracked: https://www.ae7q.com/query/list/ProcessDate.php?DATE=1994-05-24 Looks like renewals started being tracked on 1999-08-28: https://www.ae7q.com/query/list/ProcessDate.php?DATE=1999-08-28 Sometime in 2001, vanity callsigns added to that table. Table structure seems consistent over time.
W1CDN added the
data-new
label 2024-09-16 11:44:22 -05:00
Owner

I summarized down to here so far. How should I structure the final CSV file?

Shared on fedi: https://mastodon.radio/@W1CDN/113176909232406655

I summarized down to here so far. How should I structure the final CSV file? Shared on fedi: https://mastodon.radio/@W1CDN/113176909232406655 ![](/attachments/e8f9c8aa-1d81-4623-bb94-fbdd3c177ead)
186 KiB
Owner

"License Status" is current status of that license as of query date, so if you query back a ways, you will see lots of expired licenses, which isn't indicative of what the status was on that date.

Looks like SYSGRT was introduced on https://www.ae7q.com/query/list/ProcessDate.php?DATE=2004-11-29.

"License Status" is *current* status of that license as of query date, so if you query back a ways, you will see lots of expired licenses, which isn't indicative of what the status was on that date. Looks like SYSGRT was introduced on https://www.ae7q.com/query/list/ProcessDate.php?DATE=2004-11-29.
Owner

Basics are here, data is in since 2024-08-01.
Need to add plot(s) to readme when I have more data.
81e5fbef6c

Basics are here, data is in since 2024-08-01. Need to add plot(s) to readme when I have more data. https://amiok.net/gitea/W1CDN/ham-radio-licenses/commit/81e5fbef6c12ba59337f063b36d534e6b44aa69c
Owner

Added one plot to readme, will download historical data over time, new data scraped daily as part of cron job.

Added one plot to readme, will download historical data over time, new data scraped daily as part of cron job.
Owner

This script wasn't working, but I think is fixed in 1b58d335f8. It needs to query the previous date, not the current date.

This script wasn't working, but I think is fixed in 1b58d335f8. It needs to query the previous date, not the current date.
Sign in to join this conversation.
No Milestone
No project
No Assignees
2 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: W1CDN/ham-radio-licenses#114
No description provided.