Welcome to the new home of the Cumulus Support forum.

Latest Cumulus release v1.9.4 (build 1099) - Nov 28 2014
Latest Cumulus MX release - v3.0.0 build 3043 Jan 20 2017. See the Wiki for download

ImportCumulusFile error

Discussion of version 3 of Cumulus, which runs on Windows, Linux, and OS X. All Cumulus MX queries in here, please.
Post Reply
User avatar
dazza1223
Posts: 414
Joined: Sun Jan 25, 2015 8:41 pm
Weather Station: Davis Vantage Vue
Operating System: raspberry pi 3 +
Location: worthing
Contact:

ImportCumulusFile error

Post by dazza1223 » Fri Jun 29, 2018 2:52 pm

hi all im trying to put all my Monthly file in SQL database but the fist one goes in with a error

Running from web server
Script start: 29/06/18 - 15:45:35
Importing file: ./data/Aug17log.txt, To table: Monthly ...
Connected to database OK.
Set MySQL TZ OK.
Processing monthfile...
Table 'Monthly' does not exist, creating it...
Table 'Monthly' created OK.
Prepared SQL statement OK.
Inserting data...
Error: Failed to insert data, error is: Disk is full writing './cumulus/Monthly.MYD' (Errcode: 28). Waiting for someone to free space... (Expect up to 60 secs delay for server to continue after freeing disk space)
End.

then i look at the data base and i see it in there but i dont understand why is saying about Disk is full ive got 2.8tb left

so if i go and do a nother inport it just sit there saying


Inserting data...


any help plz
have fun and keep learning

dazza :D

User avatar
mcrossley
Posts: 5209
Joined: Thu Jan 07, 2010 9:44 pm
Weather Station: Davis VP2
Operating System: Stretch Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: ImportCumulusFile error

Post by mcrossley » Fri Jun 29, 2018 3:13 pm

This looks a likely candidate...
We have experienced similar issue, and the problem was MySQL used /tmp directory for its needs (it's default configuration). And /tmp was located on its own partition, that had too few space for big MySQL requests.

User avatar
dazza1223
Posts: 414
Joined: Sun Jan 25, 2015 8:41 pm
Weather Station: Davis Vantage Vue
Operating System: raspberry pi 3 +
Location: worthing
Contact:

Re: ImportCumulusFile error

Post by dazza1223 » Fri Jun 29, 2018 3:25 pm

lol what candidate mean
have fun and keep learning

dazza :D

water01
Posts: 1477
Joined: Sat Aug 13, 2011 9:33 am
Weather Station: WH1081
Operating System: Windows 7 64bit HP SP1
Location: Somewhere in the USA
Contact:

Re: ImportCumulusFile error

Post by water01 » Fri Jun 29, 2018 3:49 pm

He mean this may be your problem. It is trying to set up the database in /tmp which is running out of space.

User avatar
dazza1223
Posts: 414
Joined: Sun Jan 25, 2015 8:41 pm
Weather Station: Davis Vantage Vue
Operating System: raspberry pi 3 +
Location: worthing
Contact:

Re: ImportCumulusFile error

Post by dazza1223 » Fri Jun 29, 2018 4:08 pm

i just look in a temp dir and it ok what temp dir it go in for the nas drive
have fun and keep learning

dazza :D

User avatar
mcrossley
Posts: 5209
Joined: Thu Jan 07, 2010 9:44 pm
Weather Station: Davis VP2
Operating System: Stretch Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: ImportCumulusFile error

Post by mcrossley » Fri Jun 29, 2018 4:24 pm

MySQL uses the tmp folder by default on some installs for its working files. On Linux try looking at the output from
> df -h
and see if any of your partitions are full?

User avatar
dazza1223
Posts: 414
Joined: Sun Jan 25, 2015 8:41 pm
Weather Station: Davis Vantage Vue
Operating System: raspberry pi 3 +
Location: worthing
Contact:

Re: ImportCumulusFile error

Post by dazza1223 » Fri Jun 29, 2018 4:25 pm

%root% 54.2M 33.9M 17.5M 66% /
/dev/ram0 54.2M 33.9M 17.5M 66% /
mdev 251.2M 32.0K 251.2M 0% /dev
/dev/sda3 975.9M 192.2M 716.5M 21% /boot
/dev/sda7 976.2M 352.0K 949.7M 0% /usr/local/config
/dev/loop0 92.4M 92.4M 0 100% /usr/local/modules
tmpfs 1.0M 0 1.0M 0% /mnt
tmpfs 40.0M 2.8M 37.2M 7% /var/log
tmpfs 100.0M 4.8M 95.2M 5% /tmp
/dev/sda4 928.9M 912.9M 4.0K 100% /mnt/HD_a4
/dev/sda2 2.7T 1.3G 2.6T 0% /mnt/HD/HD_a2
have fun and keep learning

dazza :D

User avatar
mcrossley
Posts: 5209
Joined: Thu Jan 07, 2010 9:44 pm
Weather Station: Davis VP2
Operating System: Stretch Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: ImportCumulusFile error

Post by mcrossley » Fri Jun 29, 2018 4:34 pm

So you have two partitions that are full - 100%, sorry no idea what they are being used for, but /usr/local/modules being full doesn't sound good.

Code: Select all

%root%      54.2M    33.9M   17.5M   66% /
/dev/ram0   54.2M    33.9M   17.5M   66% /
mdev       251.2M    32.0K  251.2M    0% /dev
/dev/sda3  975.9M   192.2M  716.5M   21% /boot
/dev/sda7  976.2M   352.0K  949.7M    0% /usr/local/config
/dev/loop0  92.4M    92.4M       0  100% /usr/local/modules
tmpfs        1.0M        0    1.0M    0% /mnt
tmpfs       40.0M     2.8M   37.2M    7% /var/log
tmpfs      100.0M     4.8M   95.2M    5% /tmp
/dev/sda4  928.9M   912.9M    4.0K  100% /mnt/HD_a4
/dev/sda2    2.7T     1.3G    2.6T    0% /mnt/HD/HD_a2

User avatar
dazza1223
Posts: 414
Joined: Sun Jan 25, 2015 8:41 pm
Weather Station: Davis Vantage Vue
Operating System: raspberry pi 3 +
Location: worthing
Contact:

Re: ImportCumulusFile error

Post by dazza1223 » Fri Jun 29, 2018 4:41 pm

ok thank u i think i know my plans are for to night
have fun and keep learning

dazza :D

User avatar
dazza1223
Posts: 414
Joined: Sun Jan 25, 2015 8:41 pm
Weather Station: Davis Vantage Vue
Operating System: raspberry pi 3 +
Location: worthing
Contact:

Re: ImportCumulusFile error

Post by dazza1223 » Fri Jun 29, 2018 4:55 pm

hang on cant i move the temp dir to some were eles?
have fun and keep learning

dazza :D

User avatar
dazza1223
Posts: 414
Joined: Sun Jan 25, 2015 8:41 pm
Weather Station: Davis Vantage Vue
Operating System: raspberry pi 3 +
Location: worthing
Contact:

Re: ImportCumulusFile error

Post by dazza1223 » Sun Jul 01, 2018 10:51 am

hi all ive fix the error about the disk full and ive done it again and the fist one went in to the data base ok but then i did a other one and it just says

Running from web server
Script start: 01/07/18 - 11:48:38
Importing file: ./data/Feb18log, To table: Monthly ...
Error: Failed to open file: './data/Feb18log'
Script complete: 01/07/18 - 11:48:38
Execution time: 0 secs

and i look in the sql and it not in there?
have fun and keep learning

dazza :D

User avatar
mcrossley
Posts: 5209
Joined: Thu Jan 07, 2010 9:44 pm
Weather Station: Davis VP2
Operating System: Stretch Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: ImportCumulusFile error

Post by mcrossley » Sun Jul 01, 2018 9:11 pm

Error: Failed to open file: './data/Feb18log'

Isn't that filename missing the ".txt" off the end?

User avatar
dazza1223
Posts: 414
Joined: Sun Jan 25, 2015 8:41 pm
Weather Station: Davis Vantage Vue
Operating System: raspberry pi 3 +
Location: worthing
Contact:

Re: ImportCumulusFile error

Post by dazza1223 » Sun Jul 01, 2018 10:06 pm

hi mark thank for geting back to me but ive spent most off to night debugging errors out on that Feb log file and ive fix it thanks
have fun and keep learning

dazza :D

Post Reply