Organising the Archive

Lia

@biell Amazing, it worked :D Thank you so much!

I can't seem to get the favicon to work for some reason.
Tried to strip out the type="image/x-icon" from the below but that seems to cause the favicon section to then pull extra text and break.

s|(<link rel="icon" type="image/x-icon" href=").*?">|$1$META{'resources'}/favicon.ico">|mg;

Spent an hour trying to figure it out but I'm no good with interpreting code lol.

Currently the end result is the following line:
<link rel="icon" type="image/x-icon" href="../../../assets/resources/favicon.ico">
Could it be tweaked to instead generate:
<link rel="icon" href="../../../assets/resources/OWForumArchiveIcon.png">

NotSure

@lia said in Organising the Archive:

Anyone think it might be a cool idea

duh!

biell

@lia So, that was my bad. I was downloading to assets/resources, but looking for it in assets/system/uploads :(

Updated now so that the META config at the top points to the location you want for 'icon'. This way you can change it in the future if you want to, e.g. put it in /Images with OWForumArchive.png.

https://drive.google.com/file/d/1FFmb1LVADMPUvIMumuJdX50xRmqIq7iM/view

Lia

@biell Ah found the issue, there's something in the topmost tags that's busting the favicon.

Surrounding the top <style> tag is some <body> and <head> which although don't mention an icon I think they're causing the browser to ignore the tag later. Used topic 20 to test as an example below.

Starts with a <html> tag that we can keep

<!DOCTYPE html>
<html lang="en-US" data-dir="ltr" style="direction: ltr;" class="nprogress-busy">

Then the element that seems to break it starts.

<head><meta http-equiv="Content-Type" content="text/html; charset=UTF-8"><!--<base href="https://archive.owforum.co.uk/topic/20/france-onewheel-riders/990?page=110&amp;lang=en-US">--><base href=".">

In between is a style tag that we need to keep as removing this bit actually breaks some elements.

<style>body{margin-left:0;margin-right:0;margin-top:0}#bN015htcoyT__google-cache-hdr{background:#f8f9fa;font:13px arial,sans-serif;text-align:left;color:#202124;border:0;margin:0;border-bottom:1px solid #dadce0;line-height:16px;padding:16px 28px 24px 28px}#bN015htcoyT__google-cache-hdr *{display:inline;font:inherit;text-align:inherit;color:inherit;line-height:inherit;background:none;border:0;margin:0;padding:0;letter-spacing:0}#bN015htcoyT__google-cache-hdr a{text-decoration:none;color:#1a0dab}#bN015htcoyT__google-cache-hdr a:hover{text-decoration:underline}#bN015htcoyT__google-cache-hdr a:visited{color:#4b11a8}#bN015htcoyT__google-cache-hdr div{display:block;margin-top:4px}#bN015htcoyT__google-cache-hdr b{font-weight:bold;display:inline-block;direction:ltr}</style>

Then a closing section to the earlier <head> and <body> which needs removing.

</head><body class="page-topic page-topic-20 page-topic-france-onewheel-riders page-topic-category-2 page-topic-category-general-discussion parent-category-2 page-status-200 user-guest skin-noskin">

I've "repaired" topic 20 is you want to take a peak
https://archive.owforum.co.uk/topic/20/france-onewheel-riders/index.html

biell

@lia Sorry, I didn't realize all that junk was up there. Firefox was honoring a lot of that meta content outside of HEAD, which it shouldn't have, so I didn't notice it. The latest version with a fix (same google drive link) is updated and ready.

Are you sure that <style>...</style> section is necessary, what did it break? I tried wiping all of it out and couldn't find any issues.

biell

@lia I also just uploaded a version where the dates are no longer "permalink" items to post links which don't exist.

Lia

@biell If I inspect the page with F12 and remove the style a few errors show up so presumably that section is referenced. Probably not worth trying to find and remove the references so I think keeping that small <style> section will be fine.

biell

@lia I removed the post hamburger menu and made the upvote/downvote chevrons no longer links (if you clicked on any them the do nothing except take you to the top of the page).

Also, in doing that, I noticed that sometimes the timestamp is to the left because different posts have different HTML layouts. So, I fixed that too.

Same google drive link.

Lia

@biell That's amazing thank you!

I noticed that sometimes the timestamp is to the left because different posts have different HTML layouts. So, I fixed that too

I did notice this but felt it wasn't worth bothering you over. Really appreciate you going out of your way to fix that. I assume that's from the pages that didn't get saved normally.

~~Currently re-running the script and preparing to replace the live data after.~~ Finished and swapped out to the new data, looks good!!!

Just got to make my way though adding the links. So many that I might paginate the homepage a little. Anyone finding any issues with load times or overall experience so far using the archive?

biell

@lia For the main page, I feel like it should have a filter so you can type in something and search for topics. If you are interested, I did a mock-up here:

https://drive.google.com/file/d/1KCtjxqxqH3dJZPpe7QhAcb4v0qUWGS6c/view

I just threw this together in a few minutes, so the input box is literally just thrown on there in some semi-reasonable place. Essentially, as you type, it goes through the list items and changes anything which doesn't match to "display: none" and anything which does match to "display: block".

You can ignore the <base> tag, as I just needed that to make my copy work. Then, I have a new <style> which should be moved to your style.css, and a <script> which can stay there or go into it's own file. After that, I added an id to your <ul> element so I could find it, and put the <input> element on the page to type into.

Lia

@biell You're a genius. I completely wrote off the idea of a search because I had no idea how to begin with one.

I'll give that a spin when I get back home, thank you for making that!

biell

@lia That is more of a filter, just for topics. If you want a full search, I would rely on google once they have fully indexed it:

https://www.google.com/search?as_sitesearch=archive.owforum.co.uk&as_q=battery

Lia

@biell I love it, works great and makes that list a lot less intimidating :D

Implemented the search and styled it up, maybe the one bit of coding I can do somewhat competently ;)

Edit :

Also mobile version made so it's not a nightmare to use.

biell

@lia Nice, it looks good. On Firefox, the input bar sticks out right, out past the dark gray backdrop. It looks great in Chromium.

biell

@lia Also, Pro tip. It is a regular expression search, so you can type in something like this helmet|pads|ppe and get all the results which match any of those words.

Lia

@biell said in Organising the Archive:

On Firefox, the input bar sticks out right

Weird, on mine it sits in place. Typical firefox lol.
I'll look at trying to make it bound to the div so it doesn't zoom outside it.

Good suggestion with the search, I'll see if I can figure that out :)

Lia

IT

IS

DONE...

omg I can't believe it

~ ~ ~ archive.owforum.co.uk ~ ~ ~

~~1180~~ 1193 topics are available to view that I managed to salvage and with the help of @biell repaired the files.

...I am so happy.
The old forum is finally safe and available to be browsed at the leisure of anyone that wants to take a look. The place I and many of you used to call home for a while now lives on even if just as a snapshot in time. I promised myself I'd stop crying over things like this but I can't help it. I'm so happy to see it restored alongside the new forum.
alt text

This has taken so much of my time and strength but the entire collection of archived pages I collected are not only uploaded but accessible from the landing page. Rescued from the ticking time bomb that is google cache. Was extremely lucky the web-crawlers did the site literally the day before the shutdown to give me that extra time to grab it.

That isn't to say it's over though, there are plenty of topics still out there lingering in the depths of archive.org no doubt and pages I may need to manually tweak but for the most part it's done. I can sit back and fix things pointed out now the main grind is over.

I can actually cross this off my todo list, something I rarely get to do with how bad I am at finishing projects. This has been one I refused to let get shelved.

Issues to resolve so far:

~~Timestamps are missing :( I swear I saw them work once so maybe I broke that.~~
~~Some avatars are missing. When running the script line it raises a regex issue on line 344 that has something to do with avatars. I might have brokey somehow.~~
~~Site icon (favicon.ico) needs changing to OWForumArchiveIcon.png with an alteration to the tag to allow it to render not as an ico.~~
~~Topic 105 has picture issues where it appears image(x).jpg has been replaced with just image.jpg and led to repeat images.~~
~~Topic 177 didn't generate index.html so will need to manually resolve that one.~~
~~Topic 448 has some picture overlap, need to find and recover some elsewhere.~~
~~Redo the server config to remove /index.html from the URL and also interpret URLs pointing at a directory to try looking for index.html~~

Suggestions?

Create a gallery page for all the cool pics from the old forum for easy viewing. May need curation to not just display screenshots.
Create a custom 404 page for missing content.
Modify the missing post placeholder to link to a "Missing Post" thread.
Create a custom 404 for a missing topic to link to a "Missing Topic" thread.

Some faves

Some amazing pics of boards. "Post cool pics here!"
Collection of V1 mod pics. These look great! "Have you done any customization or any modification? Post pictures!"
Fabuz shares a pretty funny ride reel. "The god of Tricks!"
FM teasing an entire batch ready to ship. Look at all those V1s! "Shipping Update"
FM putting out job openings as they expand. "Job Openings"
Early W rail concept. "Few suggestions to make this better"
Plus shipping date and delivery mega-thread. "A thought: post your OW+ shipping notifications"
Flight Fins are born. "The mystery for jumping up curbs without bindings has been solved. Are you ready to fly?"
FM announces the XR. "Introducing Onewheel+ XR"
This one was a frequently requested one. "XR constantly losing app connection?"
Possibly one of Jeff's last posts on the Forum. "New Float Life Edit"
Megathread for the Pint release and shipping. "Your Pint Shipping Date"
Some Wild pics here. "In The Wild, Photo Share (If Possible To Capture)"
THE PHOTOSHOOT THREAD RETURNS! "Onewheel Photoshoot Thread..."
@HanahsDax @S-Leon Some of your winter pics have been recovered :D "Wintertime Photo Thread"
So much leaderboard action documented. "Watching Action on the Leaderboards"
@S-Leon This thread documented your Plus's evolution quite well :) "Onewheel cheap mods"
Repairing an illusive Error 16. "The dreaded Error 16 code"
More cool pics~! "Signs we see in our travels..."
@NotSure I think you'll remember this gem. "Frustrated, I sold my Onewheel and bought a scooter..."
I made some art for the forum :D "Art piece for the forum members"

Thank you all for giving me the strength and drive to do this. I didn't realise at first quite what I'd set myself up for but it's been worth every hour past midnight challenging RSI to a game of chicken.

I'd go sleep now if not for the heatwave keeping me far away from layered fabrics. Instead I'll chill with another can of monster and some YT videos.

alt text

Lia~<3

biell

@lia Great, great work. It looks nice. If you send me topics 105, 177, and 448 I will see what is wrong with them and fix the script. It is possible whatever is causing the issue has caused an issue somewhere else we don't yet know about.

biell

@lia I found an example in topic 90. Some source files list the same image as "image.jpg" and others as "image(1).jpg" depending on if another post exists with the same name "image.jpg" appears.

An updated script prepends the post ID to every image file, to ensure this doesn't happen. Now, you don't have to worry about two different posters uploading "image.jpg". My guess is that this is pretty widespread.

https://drive.google.com/file/d/1FFmb1LVADMPUvIMumuJdX50xRmqIq7iM

If you re-run the new script after the old, you will be left with both the files for the new image name (e.g. "25_image.jpg") and the old name (e.g. "image.jpg"), so it would be best to clear about a topic number before regenerating.

Sorry about that.

Lia

@biell That worked great :D

Found a folder brimming with a few files back from before I decided I would do the whole forum so just updating the naming scheme so the script accepts the data then re-running it. Some good stuff in there that fills in some blanks too .

Modified the "missing post" section to link back to the topic I created earlier to help guide viewers to help if they so desire :)

Edits below if you're interested :)

sub missing_post {
	my($id)=@_;

	return(qq{
	  <li component="topic/necro-post" class=" necro-post timeline-event" data-index="$id">
	    <small class="timeline-text">
			<span>Post(s) $id missing from the archive :(</span><br/>
			<span>Know where these posts are? Visit <a href="https://owforum.co.uk/topic/158/missing-posts">the new forum</a> for how to help get them added :)</span>
		</small>
	  </li>
	});
}