- class Stoner.DataFolder(*args, **kargs)¶
Provide an interface to manipulating lots of data files stored within a directory structure on disc.
By default, the members of the DataFolder are isntances of
Stoner.Data. The DataFolder emplys a lazy open strategy, so that files are only read in from disc when actually needed.
Add a new group to the current baseFolder with the given key.
Iterate over all the files in the Folder and all it's sub Folders recursely.
Append an item to the folder object.
Clear the subgroups.
compress([base, key, keep_terminal])
Compresses all empty groups from the root up until the first non-empty group is located.
Concatentates all the files in a objectFolder into a single metadataObject like object.
Provide a count method like a sequence.
S.extend(iterable) -- extend sequence by appending elements from the iterable
Extract metadata from each of the files in the terminal group.
Preload the contents of the DiskBasedFolderMixin.
file(name, value[, create, pathsplit])
recursely add groups in order to put the named value into a virtual tree of
filter([filter, invert, copy, recurse, prune])
Filter the current set of files by some criterion.
filterout(filter[, copy, recurse, prune])
Synonym for self.filter(filter,invert=True).
Compresses all the groups and sub-groups iunto a single flat file list.
Collect xy and y columns from the subfiles in the final group in the tree.
Return either a sub-group or named object from this folder.
Scan the current directory, optionally recursively to build a list of filenames.
Sort Files into a series of objectFolders according to the value of the key.
index(name[, start, end])
Provide an index method like a sequence.
Implement the insert method with the option to append as well.
Return the key,value pairs for the subbroups of this folder.
Filter out earlier revisions of files with the same name.
Return the keys used to access the sub-=groups of this folder.
Construct a name from the value object if possible.
Carry out processing on a newly loaded file to set means and extra metadata.
Return and remove either a subgroup or named object from this folder.
Return the most recent subgroup from this folder.
Remove any empty groups from the objectFolder (and subgroups).
S.remove(value) -- remove first occurrence of value.
S.reverse() -- reverse IN PLACE
Save the entire data folder out to disc using the groups as a directory tree.
Select a subset of the objects in the folder based on flexible search criteria on the metadata.
Return or set a subgroup or named object.
Return an array of the metadata values for each item/file in the top level group.
sort([key, reverse, recurse])
Sort the files by some key.
Take the file list an unflattens them according to the file paths.
Remove the instance from memory without losing the name in the Folder.
Update this folder with a dictionary or another folder.
Return the sub-groups of this folder.
Walk through a heirarchy of groups and calls walker for each file.
Return a list of tuples of metadataObjects drawn from the specified groups.
Return a list of just the filename parts of the objectFolder.
Clone just does a deepcopy as a property for compatibility with
Just read the local debug value.
Build a single list of all of our defaults by iterating over the __mro__, caching the result.
Give the maximum number of levels of group below the current objectFolder.
Just alias directory to root now.
Return an iterator of potentially unloaded named objects.
Subfolders are held in an ordered dictionary of groups.
Return a default instance of the type of object in the folder.
Return True if the folder is empty.
Override the parent class key to use the directory attribute.
Return a tuple that describes the number of files and groups in the folder.
Iterate only over those members of the folder in memory.
Return a callable that will load the files on demand.
List just the names of the objects in the folder.
Return a list of the groups as a generator.
Give the minimum number of levels of group below the current objectFolder.
Iterate over the objectFolder that checks whether the loaded metadataObject objects have any data.
Return an array of True/False for whether we've loaded a metadataObject yet.
Return the objects in the folder are stored in a
Provide support for getting the pattern attribute.
Return the real folder root.
Return the proxy for the setas attribute for each object in the folder.
Return a data structure that is characteristic of the objectFolder's shape.
Return the number of levels of group before a group with files is found.
Return the (sub)class of the