Home All Groups Group Topic Archive Search About

Need to select MANY files for my app

Author
8 Jul 2005 2:28 PM
MJ
I'm using the Common Dialog Control and have set the MaxFileSize to 32767,
but that is still not enough. I'm doing testing and need to load many files
( upto 10,000+). The app will then iterate through each of these and perform
some function. I could allow them to select a directory instead and iterate
through all the files, but I would rather them select the files. It won't
always be 10,000. It could be only 200 or 500 sometimes. Currently, it only
let's me load about 146.

Author
8 Jul 2005 2:47 PM
Jim Mack
MJ wrote:
> I'm using the Common Dialog Control and have set the MaxFileSize to
> 32767, but that is still not enough. I'm doing testing and need to
> load many files ( upto 10,000+). The app will then iterate through
> each of these and perform some function. I could allow them to select
> a directory instead and iterate through all the files, but I would
> rather them select the files. It won't always be 10,000. It could be
> only 200 or 500 sometimes. Currently, it only let's me load about 146.

I can't help you with your specific request, but if I am in any way a candidate for ever using your software, I'd like to strongly encourage you to rethink whatever design would require me to 'select' 10,000+ files.

--

    Jim Mack
    MicroDexterity Inc
    www.microdexterity.com
Author
8 Jul 2005 3:06 PM
Duane Bozarth
MJ wrote:
>
> ... I'm doing testing and need to load many files
> ( upto 10,000+). ...I could allow them to select a directory instead and iterate
> through all the files, but I would rather them select the files. It won't
> always be 10,000. It could be only 200 or 500 sometimes. ...

Bleech!!!

You've <got> to get some other selection criterion--this is like,
totally uncool, dood!
Author
8 Jul 2005 3:22 PM
MJ
I'm a performance engineer and we need to drive load to a system. The files
we are going to select are XML requests. To drive different loads, different
amount of files will be used (200,500,1000,2500,5000,10000,etc) . They will
be sent at a specified rate.This is not a production application or will it
be used outside our department. I'm also not a developer, but have some
development experience. I know selecting 10,000 files ordinarilly will not
be necessary, but it is for my needs. The files in the directory might not
all be XML files so letting someone select the valid files would be useful.



Show quoteHide quote
"Duane Bozarth" <dpboza***@swko.dot.net> wrote in message
news:42CE9688.72D8B94B@swko.dot.net...
> MJ wrote:
>>
>> ... I'm doing testing and need to load many files
>> ( upto 10,000+). ...I could allow them to select a directory instead and
>> iterate
>> through all the files, but I would rather them select the files. It won't
>> always be 10,000. It could be only 200 or 500 sometimes. ...
>
> Bleech!!!
>
> You've <got> to get some other selection criterion--this is like,
> totally uncool, dood!
Author
8 Jul 2005 3:42 PM
Ken Halter
"MJ" <maps***@hotmail.com> wrote in message
news:OApisD9gFHA.1416@TK2MSFTNGP09.phx.gbl...
> I'm a performance engineer and we need to drive load to a system. The
> files we are going to select are XML requests. To drive different loads,
> different amount of files will be used (200,500,1000,2500,5000,10000,etc)
> . They will be sent at a specified rate.This is not a production
> application or will it be used outside our department. I'm also not a
> developer, but have some development experience. I know selecting 10,000
> files ordinarilly will not be necessary, but it is for my needs. The files
> in the directory might not all be XML files so letting someone select the
> valid files would be useful.

You can always select the folder and process only files with an XML
extension. Also, if those "file count" numbers are fixed, you can setup
several folders and have each contain the fixed number of files.

Thing is, no matter what you try, I don't think the common dialog's going to
give you the ability to select that many separate files. If you absolutely
need this, you'll most likely need to parse a folder and still all files in
a grid/listview/or some other control that supports multi-select and let the
user select from there.

--
Ken Halter - MS-MVP-VB - http://www.vbsight.com
DLL Hell problems? Try ComGuard - http://www.vbsight.com/ComGuard.htm
Please keep all discussions in the groups..
Author
8 Jul 2005 3:54 PM
Rick Rothstein
> Thing is, no matter what you try, I don't think the common dialog's
going to
> give you the ability to select that many separate files. If you
absolutely
> need this, you'll most likely need to parse a folder and still all
files in
> a grid/listview/or some other control that supports multi-select and
let the
> user select from there.

However, before you (that is, MJ) do this, consider what you are asking
of the user (even if that is only you) in the extreme case of 10000
files. Let's say you can continuously and without pause click on 2
filenames per second.

10000 (files) / 2 (files/sec) / 60 (sec/min)  =  83.333 minutes

You will be clicking away for just under an hour and a half. Personally,
I don't think you could keep up a constant click rate for this long a
time period, so it will take you considerably longer than an hour and a
half to select your files. I definitely believe you should rethink this
approach before coding the solution any farther.

Rick
Author
8 Jul 2005 4:03 PM
Bob Butler
Show quote Hide quote
"Rick Rothstein" <rickNOSPAMnews@NOSPAMcomcast.net> wrote in message
news:O$U8gV9gFHA.1612@TK2MSFTNGP12.phx.gbl
>> Thing is, no matter what you try, I don't think the common dialog's
>> going to give you the ability to select that many separate files. If
>> you absolutely need this, you'll most likely need to parse a folder
>> and still all files in a grid/listview/or some other control that
>> supports multi-select and let the user select from there.
>
> However, before you (that is, MJ) do this, consider what you are
> asking of the user (even if that is only you) in the extreme case of
> 10000 files. Let's say you can continuously and without pause click
> on 2 filenames per second.
>
> 10000 (files) / 2 (files/sec) / 60 (sec/min)  =  83.333 minutes
>
> You will be clicking away for just under an hour and a half.

You don't use shift-click to get a whole range? (I know, I'm just in a
contrary mood today! <g>)

--
Reply to the group so all can participate
VB.Net: "Fool me once..."
Author
9 Jul 2005 12:42 PM
J French
On Fri, 8 Jul 2005 11:54:51 -0400, "Rick Rothstein"
<rickNOSPAMnews@NOSPAMcomcast.net> wrote:

<snip>

>However, before you (that is, MJ) do this, consider what you are asking
>of the user (even if that is only you) in the extreme case of 10000
>files. Let's say you can continuously and without pause click on 2
>filenames per second.

>10000 (files) / 2 (files/sec) / 60 (sec/min)  =  83.333 minutes

>You will be clicking away for just under an hour and a half. Personally,
>I don't think you could keep up a constant click rate for this long a
>time period, so it will take you considerably longer than an hour and a
>half to select your files. I definitely believe you should rethink this
>approach before coding the solution any farther.

Rick, you are forgetting the 'phone calls to the lawyer asking about
RSI compensation

- not to mention skulking in the lavatory when faced with a really
tedious job.

I think this UI is definitely a candidate for the chamber of horrors

There is another point, on a FAT system 10,000 files in one directory
is going to be very slow.
Author
9 Jul 2005 1:32 PM
Larry Serflaten
"Rick Rothstein" <rickNOSPAMnews@NOSPAMcomcast.net> wrote

> However, before you (that is, MJ) do this, consider what you are asking
> of the user (even if that is only you) in the extreme case of 10000
> files. Let's say you can continuously and without pause click on 2
> filenames per second.
>
> 10000 (files) / 2 (files/sec) / 60 (sec/min)  =  83.333 minutes
>
> You will be clicking away for just under an hour and a half.


I don't want to defer the guy from finding a better design, but a person
could open the directory, highlight the first file then Shift-click on the
very last file to select the entire set of files.  Control-clicking on any of the
files will toggle between selected and not selected for those that may not
be wanted.

That might take 15 seconds, or less....  <g>

LFS
Author
9 Jul 2005 2:10 PM
Rick Rothstein
Show quote Hide quote
> > However, before you (that is, MJ) do this, consider what you are
asking
> > of the user (even if that is only you) in the extreme case of 10000
> > files. Let's say you can continuously and without pause click on 2
> > filenames per second.
> >
> > 10000 (files) / 2 (files/sec) / 60 (sec/min)  =  83.333 minutes
> >
> > You will be clicking away for just under an hour and a half.
>
>
> I don't want to defer the guy from finding a better design, but a
person
> could open the directory, highlight the first file then Shift-click on
the
> very last file to select the entire set of files.  Control-clicking on
any of the
> files will toggle between selected and not selected for those that may
not
> be wanted.
>
> That might take 15 seconds, or less....  <g>

Yes, if all 10000 were in the same directory (probably the case given
the wording of the original post) and if the directory's total content
were the full 10000 files. However, I didn't get the impression that an
entire directory of files would always be selected. What the user is
picking 10000 files out of 20000 samples? Or what about the case when
the user needs to select a smaller sample of files, say 8000, from among
the 10000? It just seemed to me that in order to select the "right"
files, individual attention and clicking was going to be needed on the
part of the user. I could be wrong, but that was my impression at the
time of my posting.

Rick
Author
14 Jul 2005 2:03 PM
MJ
There are two ways the user (performance tester) will use this.

1) He or she just wants to send a couple of files for smoke testing or maybe
functional testing.
2) He or she is ready to load the system and wants to send all of the XML's
(roughly 10840) at a certain rate.
..
Show quoteHide quote
"Rick Rothstein" <rickNOSPAMnews@NOSPAMcomcast.net> wrote in message
news:%2333Uq$IhFHA.1468@TK2MSFTNGP14.phx.gbl...
>> > However, before you (that is, MJ) do this, consider what you are
> asking
>> > of the user (even if that is only you) in the extreme case of 10000
>> > files. Let's say you can continuously and without pause click on 2
>> > filenames per second.
>> >
>> > 10000 (files) / 2 (files/sec) / 60 (sec/min)  =  83.333 minutes
>> >
>> > You will be clicking away for just under an hour and a half.
>>
>>
>> I don't want to defer the guy from finding a better design, but a
> person
>> could open the directory, highlight the first file then Shift-click on
> the
>> very last file to select the entire set of files.  Control-clicking on
> any of the
>> files will toggle between selected and not selected for those that may
> not
>> be wanted.
>>
>> That might take 15 seconds, or less....  <g>
>
> Yes, if all 10000 were in the same directory (probably the case given
> the wording of the original post) and if the directory's total content
> were the full 10000 files. However, I didn't get the impression that an
> entire directory of files would always be selected. What the user is
> picking 10000 files out of 20000 samples? Or what about the case when
> the user needs to select a smaller sample of files, say 8000, from among
> the 10000? It just seemed to me that in order to select the "right"
> files, individual attention and clicking was going to be needed on the
> part of the user. I could be wrong, but that was my impression at the
> time of my posting.
>
> Rick
>
>
Author
14 Jul 2005 2:10 PM
Duane Bozarth
MJ wrote:
>
> There are two ways the user (performance tester) will use this.
>
> 1) He or she just wants to send a couple of files for smoke testing or maybe
> functional testing.
> 2) He or she is ready to load the system and wants to send all of the XML's
> (roughly 10840) at a certain rate.

Is there any reason in 1) to have to select a <specific> one or two out
of the 10k possible choices?

In 2) there's no reason at all to <ever> see the files at all...just a
"send all" command button is the only thing needed...
Author
14 Jul 2005 2:01 PM
MJ
Thanks guys.

I added a button to select a directory with the files for bulk testing. I
also added a "select all" button. The rate at which these files will be sent
to the system will be configurable and will probably about 1 a second. Yes,
this will take a couple of hours and that's ok. It's driving the load that
we want (certain number of requests/hour).

Show quoteHide quote
"Rick Rothstein" <rickNOSPAMnews@NOSPAMcomcast.net> wrote in message
news:O$U8gV9gFHA.1612@TK2MSFTNGP12.phx.gbl...
>> Thing is, no matter what you try, I don't think the common dialog's
> going to
>> give you the ability to select that many separate files. If you
> absolutely
>> need this, you'll most likely need to parse a folder and still all
> files in
>> a grid/listview/or some other control that supports multi-select and
> let the
>> user select from there.
>
> However, before you (that is, MJ) do this, consider what you are asking
> of the user (even if that is only you) in the extreme case of 10000
> files. Let's say you can continuously and without pause click on 2
> filenames per second.
>
> 10000 (files) / 2 (files/sec) / 60 (sec/min)  =  83.333 minutes
>
> You will be clicking away for just under an hour and a half. Personally,
> I don't think you could keep up a constant click rate for this long a
> time period, so it will take you considerably longer than an hour and a
> half to select your files. I definitely believe you should rethink this
> approach before coding the solution any farther.
>
> Rick
>
>
Author
8 Jul 2005 4:07 PM
Duane Bozarth
MJ wrote:
>
> I'm a performance engineer and we need to drive load to a system. The files
> we are going to select are XML requests. To drive different loads, different
> amount of files will be used (200,500,1000,2500,5000,10000,etc) . They will
> be sent at a specified rate.This is not a production application or will it
> be used outside our department. I'm also not a developer, but have some
> development experience. I know selecting 10,000 files ordinarilly will not
> be necessary, but it is for my needs. The files in the directory might not
> all be XML files so letting someone select the valid files would be useful.

Well, setting a wildcard specification and/or some other criteria would
satisfy that if there is any reasonable naming convention used for the
files...the thought of doing this w/ manual selection of individual
files just isn't sensible...

Show quoteHide quote
> "Duane Bozarth" <dpboza***@swko.dot.net> wrote in message
> news:42CE9688.72D8B94B@swko.dot.net...
> > MJ wrote:
> >>
> >> ... I'm doing testing and need to load many files
> >> ( upto 10,000+). ...I could allow them to select a directory instead and
> >> iterate
> >> through all the files, but I would rather them select the files. It won't
> >> always be 10,000. It could be only 200 or 500 sometimes. ...
> >
> > Bleech!!!
> >
> > You've <got> to get some other selection criterion--this is like,
> > totally uncool, dood!