[pLog-svn] big LT database

Fri May 12 18:29:41 GMT 2006

I have no editor in that server capable of editing a 900mb text file :(

I tried using sed, and it seemed to work (mysql did not complain  
anymore) but for some reason the import stopped after 4 minutes or  
so. No errors, no logs, nothing so I am a bit confused.

I tried installing mysql 4.1 from a binary package but I didn't  
succeed either...

On 12 May 2006, at 20:13, Jon Daley wrote:

> 	I will look into it.  You already tried just erasing those  
> 'comments'?
>
> On Fri, 12 May 2006, Oscar Renalias wrote:
>
>> For the life of me I can't import this into a 4.0.x instance.
>>
>> Long story short, www/devel.lifetype.net is running an old Gentoo  
>> version and we cannot upgrade any component because the compiler  
>> is broken, so mysql cannot be upgraded to 4.1.x at all...
>>
>> Would it be too much to ask to generate a 4.0.x-compatible dump? I  
>> think mysqldump has an option to define in which version the dump  
>> is going to be restored, but I cannot find it now. I will let you  
>> know if I do.
>>
>> On 7 May 2006, at 23:57, Jon Daley wrote:
>>
>>> 	I have 4.1.15, I did add a couple non-standard dump calls,  
>>> though nothing to do with character sets.  I would guess the  
>>> character set stuff isn't that important in our case?
>>> On Sun, 7 May 2006, Oscar Renalias wrote:
>>>> What version of mysql do I need? 4.0.x doesn't seem to  
>>>> understand the "meta commands" at the top of the file:
>>>> /*!40101 SET @OLD_CHARACTER_SET_CLIENT=@@CHARACTER_SET_CLIENT */;
>>>> /*!40101 SET @OLD_CHARACTER_SET_RESULTS=@@CHARACTER_SET_RESULTS */;
>>>> /*!40101 SET @OLD_COLLATION_CONNECTION=@@COLLATION_CONNECTION */;
>>>> /*!40101 SET NAMES utf8 */;
>>>> /*!40103 SET @OLD_TIME_ZONE=@@TIME_ZONE */;
>>>> /*!40103 SET TIME_ZONE='+00:00' */;
>>>> /*!40014 SET @OLD_UNIQUE_CHECKS=@@UNIQUE_CHECKS, UNIQUE_CHECKS=0  
>>>> */;
>>>> /*!40014 SET @OLD_FOREIGN_KEY_CHECKS=@@FOREIGN_KEY_CHECKS,  
>>>> FOREIGN_KEY_CHECKS=0 */;
>>>> /*!40101 SET @OLD_SQL_MODE=@@SQL_MODE,  
>>>> SQL_MODE='NO_AUTO_VALUE_ON_ZERO' */;
>>>> /*!40111 SET @OLD_SQL_NOTES=@@SQL_NOTES, SQL_NOTES=0 */;
>>>> On 6 May 2006, at 22:29, Jon Daley wrote:
>>>>
>>>>> 	New format of dump is available.  This is a "regular" dump,  
>>>>> instead of the binary form.  300MB, converts to 900MB when  
>>>>> uncompressed.
>>>>> I used the DROP TABLE IF EXISTS switch, so it should clear out  
>>>>> old stuff, though since the binary form didn't work so well,  
>>>>> probably you want to completely destroy that database to avoid  
>>>>> future problems.
>>>>>
>>>>> 	I also used a "DISABLE KEYS" switch, since that greatly  
>>>>> increased my import time.  It says it will reenable them at the  
>>>>> end, but I haven't ever used that command before.
>>>>> http://jon.limedaley.com/dump.sql.gz
>>>>> On Sat, 6 May 2006, Oscar Renalias wrote:
>>>>>> Did anybody try the database? I was trying to deploy it in  
>>>>>> devel.lifetype.net but it doesn't seem to work. I am getting  
>>>>>> these messages:
>>>>>> mysql> use generatedata;
>>>>>> Reading table information for completion of table and column  
>>>>>> names
>>>>>> You can turn off this feature to get a quicker startup with -A
>>>>>> Didn't find any fields in table 'lt_articles'
>>>>>> Didn't find any fields in table 'lt_articles_categories'
>>>>>> Didn't find any fields in table 'lt_articles_comments'
>>>>>> Didn't find any fields in table 'lt_blog_categories'
>>>>>> Didn't find any fields in table 'lt_blogs'
>>>>>> Didn't find any fields in table 'lt_config'
>>>>>> Didn't find any fields in table 'lt_custom_fields_definition'
>>>>>> Didn't find any fields in table 'lt_custom_fields_values'
>>>>>> Didn't find any fields in table 'lt_gallery_albums'
>>>>>> Didn't find any fields in table 'lt_gallery_resources'
>>>>>> Didn't find any fields in table 'lt_global_articles_categories'
>>>>>> Didn't find any fields in table 'lt_host_blocking_rules'
>>>>>> Didn't find any fields in table 'lt_mylinks'
>>>>>> Didn't find any fields in table 'lt_mylinks_categories'
>>>>>> Didn't find any fields in table 'lt_permissions'
>>>>>> Didn't find any fields in table 'lt_phpbb2_users'
>>>>>> Didn't find any fields in table 'lt_users'
>>>>>> Database changed
>>>>>> If I try to repair the tables, I get this message:
>>>>>> mysql> repair table lt_articles;
>>>>>> +--------------------------+--------+---------- 
>>>>>> +---------------------------------------------------------------- 
>>>>>> -+
>>>>>> | Table                    | Op     | Msg_type | Msg_text |
>>>>>> +--------------------------+--------+---------- 
>>>>>> +---------------------------------------------------------------- 
>>>>>> -+
>>>>>> | generatedata.lt_articles | repair | error    | Incorrect  
>>>>>> information in file: './generatedata/lt_articles.frm' |
>>>>>> +--------------------------+--------+---------- 
>>>>>> +---------------------------------------------------------------- 
>>>>>> -+
>>>>>> 1 row in set (0.00 sec)
>>>>>> I tried using all the commands I found in http://dev.mysql.com/ 
>>>>>> doc/refman/5.0/en/repair.html but it didn't help. In fact, it  
>>>>>> actually removed all the data for some of the tables.
>>>>>> Does anybody have any idea?
>>>>>> Oscar
>>>>>> On 2 May 2006, at 11:50, Jon Daley wrote:
>>>>>>> On Tue, 2 May 2006, Oscar Renalias wrote:
>>>>>>>> plog.log isn't necessary, it's just there for logging purposes.
>>>>>>> 	Right - I just didn't know if there was anything useful in  
>>>>>>> the log - I assumed not, but wanted to check before I deleted  
>>>>>>> it.
>>>>>>>> How about the files? How are you planning to provide them to  
>>>>>>>> us?
>>>>>>> 	Yup - just had to upload it.  Now available at:
>>>>>>> http://jon.limedaley.com/generatedata.tgz
>>>>>>> This is the /var/lib/mysql/generatedata directory.
>>>>>>>> I just hope this wasn't too much trouble!!
>>>>>>> 	Nope - learned a little bit about sql and indexes in the  
>>>>>>> process, so a worthwhile experience.
>>>>>>> _______________________________________________
>>>>>>> pLog-svn mailing list
>>>>>>> pLog-svn at devel.lifetype.net
>>>>>>> http://devel.lifetype.net/mailman/listinfo/plog-svn
>>>>>> _______________________________________________
>>>>>> pLog-svn mailing list
>>>>>> pLog-svn at devel.lifetype.net
>>>>>> http://devel.lifetype.net/mailman/listinfo/plog-svn
>>>>> **************************************
>>>>> Jon Daley
>>>>> http://jon.limedaley.com/
>>>>> "I think that too much media in the hands of one powerful entity
>>>>> or one individual is a mistake. I think it runs counter to the
>>>>> foundation of our country. I think it runs counter to the need
>>>>> for Americans to know that they are getting news and information
>>>>> from multiple sources that are not singularly controlled."
>>>>> -- John Kerry, June 2004
>>>>> _______________________________________________
>>>>> pLog-svn mailing list
>>>>> pLog-svn at devel.lifetype.net
>>>>> http://devel.lifetype.net/mailman/listinfo/plog-svn
>>>> _______________________________________________
>>>> pLog-svn mailing list
>>>> pLog-svn at devel.lifetype.net
>>>> http://devel.lifetype.net/mailman/listinfo/plog-svn
>>> **************************************
>>> Jon Daley
>>> http://jon.limedaley.com/
>>> I am the President of the United States, and I will not eat any  
>>> more broccoli!
>>> -- George Bush Sr.
>>> _______________________________________________
>>> pLog-svn mailing list
>>> pLog-svn at devel.lifetype.net
>>> http://devel.lifetype.net/mailman/listinfo/plog-svn
>>
>> _______________________________________________
>> pLog-svn mailing list
>> pLog-svn at devel.lifetype.net
>> http://devel.lifetype.net/mailman/listinfo/plog-svn
>
> **************************************
> Jon Daley
> http://jon.limedaley.com/
>
> I will never apologize for the United States of America, ever.
> I don't care what the facts are.
> -- George Bush Sr.
> _______________________________________________
> pLog-svn mailing list
> pLog-svn at devel.lifetype.net
> http://devel.lifetype.net/mailman/listinfo/plog-svn
>