SRIIA TECHNOLOGIES

SCAN STORE RETRIEVE INDEX INTEGRATE ARCHIVE

Tag Archives: scanners

Explosion of Digital Storage Worldwide

Research company IDC last year forecast that 2010 would see the volume of  digital data stored by everyone on the planet reach 1.2 zettabytes (1.2 billion  terabytes), representing growth of 62 per cent over 2009. And by 2020, that  volume will have grown by a factor of 44 to 35 trillion gigabytes.

Read more: http://www.computing.co.uk/ctg/feature/2075349/overload-averted-essential-guide-storage-solutions#ixzz1OD4sE1It

Research from Gartner estimates data capacity in those enterprises is growing by  40-60 per cent per year on average, not enough to cope with demand if IDC’s  statistics prove accurate. Its survey of 1,004 companies in eight countries  conducted in August 2010 identified data growth as the top data-centre  challenge, followed by system performance and scalability, and network  congestion and connectivity architecture.

This Washington Post article sited further reinforces the predicted coming explosion in on-line data storage;

Exabytes: Documenting the ‘digital age’ and huge growth in computing capacity

How Redaction works for the Public Record (Recorders, Registers, Clerks, etc…)

At the state and local level, our elected officials are responsible to manage and make available Public Records. While doing this, they must be aware that some of these Public Records contain Private Information. Think about the volume of land related records your local county office deals with. Every transaction where a piece of land or property changes ownership, a voluminous collection of documentation follows. Title information, mortgage/loan information, historical information such as liens, court information and related documents all have some influence as to the disposition of any piece land or property.

Found within these numerous documents can be found varying types and amounts of Personal Identifying Information (PII) such as social security numbers, dates of birth, credit and bank card numbers, driver’s license numbers and etc. Now, add the additional complexity that web access to these documents is now de facto.  The voting public and private industry simply demand electronic information exchange.

More and more county and state offices are adopting electronic technology to manage their core business operations. Because of this, the inter/intra office, departmental and division communication is becoming more and more electronic based. Document sharing is no longer sending volumes of paper documents, but allowing access via an on-line computer application.

So how does a state/local official comply with current statutes and laws to provide open access to Public Records without exposing individual’s Personal Identifying Information (PII), especially via the web? And the question as to why they would not want to expose the PII should be rhetorical. Considering the current environment of identity theft we all exist within each day, information security is of paramount concern.

The answer is called Redaction:

Redaction is the process of covering over or blacking out specific information within a document. For hardcopy documents, this can be overwhelming task. Each time a person comes into a government office to research and gather information and makes copies of Public Information for personal or private use, the office has the risk that someone will walk out with someone else’s PII.

Or, when county offices receive record requests via snail mail, many offices today still deliver the information via hardcopy documents.

Example of legacy document hardcopy transaction:

  1. Original requested documents are located and photocopied;
  2. PII is redacted from photocopy using a marker of some type;
  3. The redacted copy is photocopied to eliminate the opportunity of bleed-through of original information;
  4. Original copy is re-filed, requested copy is mailed, and original photocopy is destroyed.

For day-forward electronic transactions:

Day-Forward Processing: Using an automated redaction software product

Documents can enter a local government office in a variety of ways;

  • Public Access software (E-Recording) (Simplifile, Ingeo, etc…)
  • Fax
  • Title Company
  • Gov-to-Gov interchange
  • Web Portal
  • Other

As each new document is received in an office:

  1. The document is scanned or received electronically;
  2. Workflow driven process pushes image through an automated redaction product;
  3. Image comes up for manual human review and verification;
  4. Redacted image is electronically copied, creating a “public, redacted” version;
  5. The image follows normal workflow process until final document is verified and made available for view;

The original, non-redacted image remains in-tact while the redacted version is made available for public access.

If you have legacy/historical documents that need to be redacted, you should check with your automated redaction software vendor to see what they suggest. If your legacy documents are still on paper or film, you will need to go through the exercise of digitizing these documents. See my posts on preparing for conversion projects for assistance.

If your documents are already digitized, then your vendor may be able to facilitate your office doing verification of the images they process through their automated redaction software. Your CAPEX would be minimized by doing the verification work in-house.

I would not suggest trying to process all of your legacy documents through an automated redaction software product in-house. Processing millions of images through redaction software is very processor heavy – your office would probably need to purchase expensive servers if you chose to do the entire project in-house.

Is Document Management Still a Viable Market?

Following the “glass half-empty” analogy, many have said that the document conversion and document management industry is nearing its end. “They” claim all the paper in the world has been scanned and every business has already purchased their fancy new EDMS (Electronic Document Management Software) and ECMS (Enterprise Content Management Software).

Well, not so fast. In a recent survey done by Eclipse Group, an international services firm providing document and content management solutions, they found that an alarming number of businesses and organizations today are still heavily reliant upon paper based business critical processes.

Key findings:

  • 75% of companies are still heavily reliant on paper based invoicing processes
  • 67% of respondents are currently sending the majority of their sales invoices by paper rather than electronically using a document management solution
  • 75% of respondents are currently sending the majority of their purchase invoices by paper rather than using a document management system
  • 83% currently have to re-type invoices received into their finance system

The survey, which includes the views of financial professionals from a variety of sectors including insurance, financial services, industrial and automotive, also found that 83% of respondents currently have to re-type invoices into their finance system upon receipt into the accounts departments rather than using a document management system, raising serious concerns over accuracy and efficiency.

Gary Waylett, CEO of Eclipse Group commented, “Given the efficient way most businesses are now able to share information, it is surprising to find so many finance departments are not using a document management solution and continue to re-key data between systems. In addition to duplicating effort, and hence adding cost, re-keying significantly adds the risk of errors which then complicates the reconciliation process.”

So take heart all of you software and services companies, business will be good for years to come.

10 Questions to Ask Before Starting Your Backfile Scanning Project

Backfile Scanning: Prior to beginning any type of backfile scanning  project, you must determine one goal; “Ultimately, how do I need to use these digital images?” If you only need copies of your images on USBs or DVDs, then that is all you  need to ask for. But if you actually intend on accessing these documents in  their digital format within your document or content management system, then you will need to establish a way to ensure you are receiving what you are expecting.

Good Questions to ask you conversion vendor:

  1. How are we going to look-up these records digitally?
  2. The image quality is important to us – must we pay extra for image enhancement.
  3. Will we  be able to do a full-text search within these records?
  4. How much space will these images take up on our servers?
  5. What image format do we need?
  6. Do we need additional software to search for and view the digital records or can we use what we have?
  7. How will the accuracy be calculated for this project?
  8. How long with the project take?
  9. How will we be allowed to review the work?
  10. 10. What is your guarantee policy?

Government Software Buyer Beware – Avoid Proprietary

This might be better stated as “beware of proprietary image file types”. 

It was during the 1980’s when document management software first impacted the day-to-day business of local government. The ability to convert paper and microfilm images into digital images and then access them on a computer was almost revolutionary. Maybe it was… Initially, document management software vendors created closed architecture applications that relied upon proprietary (non-standard) image file types. Today we would consider standard image file types (not including-Microsoft/Windows types) as, Group IV tif, PDF, JPEG, GIF and etc…

These early developers of document management products competed primarily against themselves for much of this government business. A vendor could produce a reliable product, distribute it heavily and charge just about whatever they wanted for annual support. Vendors locked government offices into long-term support contracts for what seemed like perpetuity.

However, many of these vendors could not or would not keep up with the rapid evolution of technology. The platforms they originally built upon and the development languages they used became obsolete. The document management world began to embrace more standard platforms and languages.

Government offices found themselves locked into early generation document management products that did not deliver as well as new technology. Support costs were high and performance, by comparison, was poor.

So here is where the really big problem came into view. As government offices were deciding to upgrade to new document management technology, they became aware that they could not use their legacy images. Why, because the legacy images were in proprietary formats. These images could only be viewed in the original, now obsolete, software. Converting the proprietary images to standard image formats could only be done by the original vendor, and you guessed it, vendors were charging outrageous fees for these services. The fees required to convert their legacy images many times made the move to new technology cost prohibitive. Eventually, all of these dinosaurs became extinct, right….

Wrong – Proprietary is back and in a big way. There are multiple vendors in the local government market today selling document conversion services bundled with proprietary software. Deals are disguised as exceptionally inexpensive conversion services bundled with the vendor’s proprietary document viewing software. We know that price is always the predominant factor in purchasing at the local government level. However, what has happened now, un-suspecting government offices find themselves in the same predicament as their predecessors 20 years ago. The upfront price to provide the document conversion services seems too good to be true – and it is. Just like in days past, when the government office needs to export their images out of this proprietary environment for other uses, the answer from their vendor is “NO, you cannot have your images”.  These un-suspecting government customers are required to view their scanned images in the vendor’s software or not at all. To have use of the images in another document management system, you will need to pay to have the original documents scanned again.

How to avoid this trap?               

Prior to signing any contract with a document conversion vendor, demand that you receive your images in a standard format that you can use in any system. This will deter most of the proprietary vagrants from trying to lock you and your department into an embarrassing mess.

Beware…

%d bloggers like this: