large files
Ivan Fernandez
ivan at vyb.com
Wed Oct 17 13:45:03 GMT 2001
Hi there Don,
I'm sending (sorry for the length of the log) all what happens since
last "good position" (before we reach a 4 Gb file) till server is shut down.
Hope you or someone else can take a look at it and discover what's wrong in
smb talk from ntbackup or samba.
Thanks a lot!!
[2001/10/17 22:23:53, 10] smbd/fileio.c:seek_file(63)
seek_file: requested pos = 4294974463, new pos = 4294974463 <--- this is
65536 bytes (1 SMB packet before 4 Gb)
[2001/10/17 22:23:53, 3] smbd/reply.c:reply_write_and_X(2783)
writeX fnum=5775 num=1 wrote=1
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(292)
size=47
smb_com=0x2f
smb_rcls=0
smb_reh=0
smb_err=0
smb_flg=136
smb_flg2=1
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(298)
smb_tid=2
smb_pid=65279
smb_uid=101
smb_mid=51970
smt_wct=6
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[0]=255 (0xFF)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[1]=0 (0x0)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[2]=1 (0x1)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[3]=0 (0x0)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[4]=0 (0x0)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[5]=0 (0x0)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(308)
smb_bcc=0
[2001/10/17 22:23:53, 6] lib/util_sock.c:write_socket(559)
write_socket(13,51)
[2001/10/17 22:23:53, 6] lib/util_sock.c:write_socket(562)
write_socket(13,51) wrote 51
[2001/10/17 22:23:53, 10]
lib/util_sock.c:read_smb_length_return_keepalive(601)
got smb length of 80
[2001/10/17 22:23:53, 6] smbd/process.c:process_smb(836)
got message type 0x0 of len 0x50
[2001/10/17 22:23:53, 3] smbd/process.c:process_smb(837)
Transaction 8937 of length 84
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(292)
size=80
smb_com=0x32
smb_rcls=0
smb_reh=0
smb_err=0
smb_flg=24
smb_flg2=2055
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(298)
smb_tid=2
smb_pid=65279
smb_uid=101
smb_mid=51970
smt_wct=15
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[0]=4 (0x4)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[1]=0 (0x0)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[2]=100 (0x64)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[3]=800 (0x320)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[4]=0 (0x0)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[5]=0 (0x0)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[6]=0 (0x0)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[7]=0 (0x0)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[8]=0 (0x0)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[9]=4 (0x4)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[10]=72 (0x48)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[11]=0 (0x0)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[12]=80 (0x50)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[13]=1 (0x1)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[14]=7 (0x7)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(308)
smb_bcc=15
[2001/10/17 22:23:53, 10] lib/util.c:dump_data(1481)
[000] 00 EE EE EE EE EE EE 8F 16 02 01 EE EE EE EE ........ .......
[2001/10/17 22:23:53, 3] smbd/process.c:switch_message(650)
switch message SMBtrans2 (pid 18433)
[2001/10/17 22:23:53, 3] smbd/sec_ctx.c:set_sec_ctx(317)
setting sec ctx (0, 1008) - sec_ctx_stack_ndx = 0
[2001/10/17 22:23:53, 3] smbd/sec_ctx.c:set_sec_ctx(322)
1 user groups:
1008
[2001/10/17 22:23:53, 5] smbd/uid.c:become_user(203)
become_user uid=(0,0) gid=(0,1008)
[2001/10/17 22:23:53, 3] smbd/trans2.c:call_trans2qfilepathinfo(1322)
call_trans2qfilepathinfo: TRANSACT2_QFILEINFO: level = 258
[2001/10/17 22:23:53, 3] smbd/trans2.c:call_trans2qfilepathinfo(1388)
call_trans2qfilepathinfo kwisatz.bkf level=258 call=7 total_data=0
[2001/10/17 22:23:53, 8] smbd/dosmode.c:dos_mode(125)
dos_mode: kwisatz.bkf
[2001/10/17 22:23:53, 8] lib/util.c:is_in_path(1152)
is_in_path: kwisatz.bkf
[2001/10/17 22:23:53, 8] lib/util.c:is_in_path(1157)
is_in_path: no name list.
[2001/10/17 22:23:53, 8] smbd/dosmode.c:dos_mode(169)
dos_mode returning a
[2001/10/17 22:23:53, 9] smbd/trans2.c:send_trans2_replies(159)
t2_rep: params_sent_thistime = 2, data_sent_thistime = 22, useable_space =
65471
[2001/10/17 22:23:53, 9] smbd/trans2.c:send_trans2_replies(161)
t2_rep: params_to_send = 2, data_to_send = 22, paramsize = 2, datasize =
22
[2001/10/17 22:23:53, 6] lib/util_sock.c:write_socket(559)
write_socket(13,88)
[2001/10/17 22:23:53, 6] lib/util_sock.c:write_socket(562)
write_socket(13,88) wrote 88
[2001/10/17 22:23:53, 10]
lib/util_sock.c:read_smb_length_return_keepalive(601)
got smb length of 48
[2001/10/17 22:23:53, 6] smbd/process.c:process_smb(836)
got message type 0x0 of len 0x30
[2001/10/17 22:23:53, 3] smbd/process.c:process_smb(837)
Transaction 8938 of length 52
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(292)
size=48
smb_com=0xb
smb_rcls=0
smb_reh=0
smb_err=0
smb_flg=24
smb_flg2=2055
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(298)
smb_tid=2
smb_pid=65279
smb_uid=101
smb_mid=51970
smt_wct=5
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[0]=5775 (0x168F)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[1]=0 (0x0)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[2]=7168 (0x1C00)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[3]=0 (0x0)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(303)
smb_vwv[4]=0 (0x0)
[2001/10/17 22:23:53, 5] lib/util.c:show_msg(308)
smb_bcc=3
[2001/10/17 22:23:53, 10] lib/util.c:dump_data(1481)
[000] 01 00 00 ...
[2001/10/17 22:23:53, 3] smbd/process.c:switch_message(650)
switch message SMBwrite (pid 18433)
[2001/10/17 22:23:53, 3] smbd/sec_ctx.c:set_sec_ctx(317)
setting sec ctx (0, 1008) - sec_ctx_stack_ndx = 0
[2001/10/17 22:23:53, 3] smbd/sec_ctx.c:set_sec_ctx(322)
1 user groups:
1008
[2001/10/17 22:23:53, 5] smbd/uid.c:become_user(203)
become_user uid=(0,0) gid=(0,1008)
[2001/10/17 22:23:55, 3] smbd/reply.c:reply_write(2685)
write fnum=5775 num=0 wrote=0
[2001/10/17 22:23:55, 5] lib/util.c:show_msg(292)
size=37
smb_com=0xb
smb_rcls=0
smb_reh=0
smb_err=0
smb_flg=136
smb_flg2=1
[2001/10/17 22:23:55, 5] lib/util.c:show_msg(298)
smb_tid=2
smb_pid=65279
smb_uid=101
smb_mid=51970
smt_wct=1
[2001/10/17 22:23:55, 5] lib/util.c:show_msg(303)
smb_vwv[0]=0 (0x0)
[2001/10/17 22:23:55, 5] lib/util.c:show_msg(308)
smb_bcc=0
[2001/10/17 22:23:55, 6] lib/util_sock.c:write_socket(559)
write_socket(13,41)
[2001/10/17 22:23:55, 6] lib/util_sock.c:write_socket(562)
write_socket(13,41) wrote 41
[2001/10/17 22:23:55, 10]
lib/util_sock.c:read_smb_length_return_keepalive(601)
got smb length of 65600
[2001/10/17 22:23:55, 6] smbd/process.c:process_smb(836)
got message type 0x0 of len 0x10040
[2001/10/17 22:23:55, 3] smbd/process.c:process_smb(837)
Transaction 8939 of length 65604
[2001/10/17 22:23:55, 5] lib/util.c:show_msg(292)
size=65600
smb_com=0x2f
smb_rcls=0
smb_reh=0
smb_err=0
smb_flg=24
smb_flg2=10247
[2001/10/17 22:23:55, 5] lib/util.c:show_msg(298)
smb_tid=2
smb_pid=65279
smb_uid=101
smb_mid=52032
smt_wct=14
[2001/10/17 22:23:55, 5] lib/util.c:show_msg(303)
smb_vwv[0]=255 (0xFF)
[2001/10/17 22:23:55, 5] lib/util.c:show_msg(303)
smb_vwv[1]=57054 (0xDEDE)
[2001/10/17 22:23:55, 5] lib/util.c:show_msg(303)
smb_vwv[2]=5775 (0x168F)
[2001/10/17 22:23:55, 5] lib/util.c:show_msg(303)
smb_vwv[3]=0 (0x0)
[2001/10/17 22:23:55, 5] lib/util.c:show_msg(303)
smb_vwv[4]=65522 (0xFFF2)
[2001/10/17 22:23:55, 5] lib/util.c:show_msg(303)
smb_vwv[5]=65535 (0xFFFF)
[2001/10/17 22:23:55, 5] lib/util.c:show_msg(303)
smb_vwv[6]=65535 (0xFFFF)
[2001/10/17 22:23:55, 5] lib/util.c:show_msg(303)
smb_vwv[7]=0 (0x0)
[2001/10/17 22:23:55, 5] lib/util.c:show_msg(303)
smb_vwv[8]=0 (0x0)
[2001/10/17 22:23:55, 5] lib/util.c:show_msg(303)
smb_vwv[9]=1 (0x1)
[2001/10/17 22:23:55, 5] lib/util.c:show_msg(303)
smb_vwv[10]=0 (0x0)
[2001/10/17 22:23:55, 5] lib/util.c:show_msg(303)
smb_vwv[11]=64 (0x40)
[2001/10/17 22:23:55, 5] lib/util.c:show_msg(303)
smb_vwv[12]=0 (0x0)
[2001/10/17 22:23:55, 5] lib/util.c:show_msg(303)
smb_vwv[13]=0 (0x0)
[2001/10/17 22:23:55, 5] lib/util.c:show_msg(308)
smb_bcc=1
[2001/10/17 22:23:55, 10] lib/util.c:dump_data(1481)
[000] EE .
[2001/10/17 22:23:55, 3] smbd/process.c:switch_message(650)
switch message SMBwriteX (pid 18433)
[2001/10/17 22:23:55, 3] smbd/sec_ctx.c:set_sec_ctx(317)
setting sec ctx (0, 1008) - sec_ctx_stack_ndx = 0
[2001/10/17 22:23:55, 3] smbd/sec_ctx.c:set_sec_ctx(322)
1 user groups:
1008
[2001/10/17 22:23:55, 5] smbd/uid.c:become_user(203)
become_user uid=(0,0) gid=(0,1008)
[2001/10/17 22:23:55, 10] smbd/fileio.c:seek_file(63)
seek_file: requested pos = 4294049792, new pos = 4294049792
[2001/10/17 22:24:17, 3] smbd/sec_ctx.c:set_sec_ctx(317)
setting sec ctx (0, 0) - sec_ctx_stack_ndx = 0
[2001/10/17 22:24:17, 5] smbd/uid.c:unbecome_user(217)
unbecome_user now uid=(0,0) gid=(0,0)
[2001/10/17 22:24:17, 2] smbd/server.c:exit_server(448)
Closing connections
[2001/10/17 22:24:17, 3] smbd/connection.c:yield_connection(50)
Yielding connection to
[2001/10/17 22:24:17, 3] smbd/server.c:exit_server(483)
Server exit (caught signal)
[2001/10/17 22:24:30, 3] smbd/sec_ctx.c:set_sec_ctx(317)
setting sec ctx (0, 0) - sec_ctx_stack_ndx = 0
[2001/10/17 22:24:30, 5] smbd/uid.c:unbecome_user(217)
unbecome_user now uid=(0,0) gid=(0,0)
[2001/10/17 22:24:30, 2] smbd/server.c:exit_server(448)
Closing connections
[2001/10/17 22:24:30, 3] smbd/sec_ctx.c:set_sec_ctx(317)
setting sec ctx (0, 0) - sec_ctx_stack_ndx = 0
[2001/10/17 22:24:30, 5] smbd/uid.c:unbecome_user(217)
unbecome_user now uid=(0,0) gid=(0,0)
[2001/10/17 22:24:30, 1] smbd/service.c:close_cnum(646)
kwisatz (192.168.0.2) closed connection to service backup
[2001/10/17 22:24:30, 3] smbd/connection.c:yield_connection(50)
Yielding connection to backup
[2001/10/17 22:24:30, 10] locking/posix.c:posix_locking_close_file(1309)
posix_locking_close_file: file kwisatz.bkf has no outstanding locks.
[2001/10/17 22:24:30, 2] smbd/close.c:close_normal_file(205)
admin closed file kwisatz.bkf (numopen=0)
[2001/10/17 22:24:30, 5] smbd/files.c:file_free(306)
freed files structure 5775 (0 used)
[2001/10/17 22:24:30, 3] smbd/sec_ctx.c:set_sec_ctx(317)
setting sec ctx (0, 0) - sec_ctx_stack_ndx = 0
[2001/10/17 22:24:30, 5] smbd/uid.c:unbecome_user(217)
unbecome_user now uid=(0,0) gid=(0,0)
[2001/10/17 22:24:30, 3] smbd/vfs.c:vfs_ChDir(643)
vfs_ChDir to /
[2001/10/17 22:24:30, 8] tdb/tdbutil.c:tdb_unpack(320)
tdb_unpack(fffdd, 38) -> 38
[2001/10/17 22:24:30, 4] passdb/pampass.c:smb_pam_start(460)
smb_pam_start: PAM: Init user: admin
[2001/10/17 22:24:30, 4] passdb/pampass.c:smb_pam_start(475)
smb_pam_start: PAM: setting rhost to: kwisatz.vyb.local
[2001/10/17 22:24:30, 4] passdb/pampass.c:smb_pam_start(484)
smb_pam_start: PAM: setting tty
[2001/10/17 22:24:30, 4] passdb/pampass.c:smb_pam_start(492)
smb_pam_start: PAM: Init passed for user: admin
[2001/10/17 22:24:30, 4] passdb/pampass.c:smb_internal_pam_session(650)
smb_internal_pam_session: PAM: tty set to: smb/1
[2001/10/17 22:24:30, 4] passdb/pampass.c:smb_pam_end(442)
smb_pam_end: PAM: PAM_END OK.
[2001/10/17 22:24:30, 3] smbd/connection.c:yield_connection(50)
Yielding connection to
[2001/10/17 22:24:30, 3] smbd/server.c:exit_server(483)
Server exit (caught signal)
-----Mensaje original-----
De: samba-admin at lists.samba.org [mailto:samba-admin at lists.samba.org]En
nombre de MCCALL,DON (HP-USA,ex1)
Enviado el: miércoles, 17 de octubre de 2001 21:12
Para: 'ivan at vyb.com'; samba at lists.samba.org
Asunto: RE: large files
Ok,
I don't have any time to look at this at the moment, but it sure does sound
like an internal storage issue from the data
you supply:
Since you can copy the file ONTO the fs that samba is sharing out, obviously
your fs can handle a file that large.
But the concern is that some of your OS utilities like stat, etc, are NOT
reporting the size right. This indicates to me
that perhaps a system call that Samba is using to return file/filesystem
informatino back to the pc in response to a smb
is not able to do the job, and thus the program on nt is thinking that it
can't create a file any bigger than 4 or 2 gigabytes.
If you turned on debug during the ntbackup and saved off the debug file as
soon as the ntbackup program died, we might be able to see exactly what smb
was being processed when it failed. This would tell us what system call was
being made by samba to give that info, and we would have a better idea. BUT
the fact that stat, etc is not working properly on your system is IMHO the
most likely culprit You might want to check the patches and fixes in later
revisions of the os to see if fstat, stat, or other system calls have
reported a problem that is fixed...
Hope this helps,
Don
-----Original Message-----
From: Ivan Fernandez [mailto:ivan at vyb.com]
Sent: Wednesday, October 17, 2001 2:49 PM
To: samba at lists.samba.org
Subject: Re: large files
Hi Joseph,
please read the message entirely. I say I can copy the 22 Gb file onto
the samba server with no problems. (I'm using ReiserFS 3.6).
Cheers!
-----Mensaje original-----
De: samba-admin at lists.samba.org [ mailto:samba-admin at lists.samba.org
<mailto:samba-admin at lists.samba.org> ]En nombre de Joseph Loo
Enviado el: miércoles, 17 de octubre de 2001 15:30
Para: samba list
Asunto: Re: large files
I am not sure but you might be running into the limitations of the ext2 file
ssytem. I believe it has a 4 Gbyte limitation on a single file. You might
have to consider another file system for your large files.
Ivan Fernandez wrote:
I'm reposting this problem (perhaps a bug) now I've got more information on
it. This is another point of view of the situation and I hope someone could
have run into the same trouble before (and solved it :-))
This is it:
* with ntbackup 2000 I create a 22Gb .bkf file in the windows
machine.
* I can copy that file over a samba share and get correct info form
the file in windows explorer.
* ls -l also returns correct info, *WHILE* stat, mc, and other
programs raise up with an error regarding a value too high for defined data
type.
* If I try to create the file with ntbackup directly over the share,
it gets downsized to 0 bytes and grows slowly while ntbackup dies when the
file crosses the 4 Gb (exactly) size.
*I have compiled myself version 2.2.2 of samba and, surprisingly,
the 4Gb "limit" situation described above was taken down to 2 Gb exactly.
Any idea on what's happening, please??
Thanks all for reading (and more more thanks if someone responds!)
--
Joseph Loo
jloo at acm.org
-------------- next part --------------
HTML attachment scrubbed and removed
More information about the samba
mailing list