Truncated Posts

Sep 6, 2015 at 1:36 PM
Administrator
Forum Administrator
"Life begins and ends with Nu."
Join Date: Jul 15, 2007
Location: Australia
Posts: 6211
Age: 38
A number of posts after the move were truncated (cut short). It doesn't seem to be related to the length of the posts, and it isn't all that common, but I would like to fix whatever posts I can.

Given that I at present have no real way to find out which posts were broken, and given that I can only fix posts on a case by case basis, I will need everyone to help me out by reporting broken posts.
 
Sep 6, 2015 at 8:37 PM
Been here way too long...
Discord Group Admin
Org Discord Moderator
"Life begins and ends with Nu."
Join Date: Oct 18, 2011
Location:
Posts: 2335
Look through Quick Modding/Hacking Answers. I think it may be related to the < character, which is why so many get cut short in that thread. Do you think that maybe it's trying to parse that as HTML or something stupid like that?
 
Sep 6, 2015 at 10:40 PM
Based Member
"Life begins and ends with Nu."
Join Date: Dec 31, 2011
Location: United States
Posts: 2307
Age: 27
Here are the posts that I found in my first run through:

http://www.cavestory.org/forums/threads/cave-story-with-a-fourth-ending.3832/page-2#post-145746
http://www.cavestory.org/forums/threads/cave-story-with-a-fourth-ending.3832/page-4#post-145786
http://www.cavestory.org/forums/threads/cave-story-with-a-fourth-ending.3832/page-4#post-145790
http://www.cavestory.org/forums/threads/cave-story-with-a-fourth-ending.3832/page-4#post-145805
http://www.cavestory.org/forums/threads/original-mod-idea-do-not-steal.4580/#post-163164
http://www.cavestory.org/forums/thr...-the-person-above-you.1336/page-92#post-59490
http://www.cavestory.org/forums/threads/alternate-path-ending.1664/#post-72712
http://www.cavestory.org/forums/threads/the-fourth-annual-kanpachis.5165/page-3#post-176789
http://www.cavestory.org/forums/threads/plus-porter-1-1-0-1.5150/
http://www.cavestory.org/forums/threads/plus-porter-1-1-0-1.5150/page-3#post-176363
http://www.cavestory.org/forums/threads/plus-porter-1-1-0-1.5150/page-3#post-176367
http://www.cavestory.org/forums/threads/plus-porter-1-1-0-1.5150/page-3#post-176368
http://www.cavestory.org/forums/threads/plus-porter-1-1-0-1.5150/page-4#post-176373
http://www.cavestory.org/forums/threads/plus-porter-1-1-0-1.5150/page-4#post-176374
http://www.cavestory.org/forums/threads/plus-porter-1-1-0-1.5150/page-5#post-176412

I could have sworn that the OP had some content in it about presenting the idea that the Doctor was Sue's father:
http://www.cavestory.org/forums/threads/who-is-sues-father-11.4077/

Like Dunc said, there does indeed seem to be some connection between these truncated posts and the "<" character, as a lot of posts get cut off when someone was clearly going to mention a TSC command, although that does not seem to always be the case.
 
Sep 7, 2015 at 3:26 AM
Bonds that separate us
Forum Administrator
"Life begins and ends with Nu."
Join Date: Aug 20, 2006
Location:
Posts: 2846
Age: 33
It wouldn't surprise me if that were the case, IP Board would display posts after the < if submitted initially but if you went to edit them all the text after would be lost, so it's possible they weren't read properly during the shift. In this case there may be a lot of old posts in the modding section that need fixing D:
 
Sep 7, 2015 at 4:02 AM
Administrator
Forum Administrator
"Life begins and ends with Nu."
Join Date: Jul 15, 2007
Location: Australia
Posts: 6211
Age: 38
SELECT * FROM REDACTED WHERE REDACTED LIKE '%&lt;%'
6217 results.
"F**K!"
 
Sep 7, 2015 at 4:04 AM
In my body, in my head
Forum Moderator
"Life begins and ends with Nu."
Join Date: Aug 28, 2009
Location: The Purple Zone
Posts: 5998
we should probably just erase those posts entirely, because to leave them half-full is very unprofessional
and of course we simply don't have the man-hours to pull off a replacement like that.
 
Sep 7, 2015 at 4:33 AM
Bonds that separate us
Forum Administrator
"Life begins and ends with Nu."
Join Date: Aug 20, 2006
Location:
Posts: 2846
Age: 33
What no that's a terrible idea, why would we ever want to lose that much information/history?

Assuming it is the problem (seems increasibly probable), would a script work at all? If not, it's probably only a few hundred posts in actuality, because some will be TSC dumps with multiple commands. I could fix them if nobody else wants to :v
 
Sep 7, 2015 at 4:46 AM
Lvl 1
Forum Moderator
"Life begins and ends with Nu."
Join Date: May 28, 2008
Location: PMMM MMO
Posts: 3713
Age: 31
Assuming it is the problem (seems increasibly probable), would a script work at all? If not, it's probably only a few hundred posts in actuality, because some will be TSC dumps with multiple commands. I could fix them if nobody else wants to :v

I'm not sure if you're aware how SQL works, but it's likely that andy was querying the FORUM_POSTS table or something and checking the POST_CONTENT field. That is, that query isn't counting the number of "<"s in posts but the number of posts with "<" in them. So there's likely 6000+ posts that need fixing.
 
Sep 7, 2015 at 5:13 AM
Administrator
Forum Administrator
"Life begins and ends with Nu."
Join Date: Jul 15, 2007
Location: Australia
Posts: 6211
Age: 38
I have a converter from that "BBCode in IPB4" project I abandoned before the IPB to XF move. I can in theory use it to write a script that may auto-fix five-sixths of those posts. So please refrain from deleting posts.

And GIR is correct. If the "posts with < in them were truncated" theory holds up then we have over 6000 broken posts. It isn't just tsc commands but also stuff like :-< and <3 and >_<.

EDIT: I'm working out any kinks in the system before I do an auto-run of the script, but it's looking good. The worst that could happen is that some of these posts may become slightly visually broken but at least they won't be missing anything.

EDIT2: My script is finished and has finished running (it sits at around 1000 lines of code). All but 149 of the broken list pile have been fixed. The remaining posts I'll have to fix manually.

EDIT3: Down to 105 posts left to manually fix.

EDIT4: 75 left to go.

EDIT5: Finished. All 6217 posts should be fixed.
 
Last edited:
Top