Home Up Feedback Contents SearchForum TechnologyDWT


Technology's Influence on Community

Lotus Notes and Adaptability to Needs

 

Abstract:  An seven-year experience in development of an on-line community among Lotus' Business Partners ("the Forum") was, naturally enough, based on Lotus Notes and Domino.  However, the technologically-advanced population leveraged their expertise and skill to uniquely modify and adapt the technology to suit their needs, as they evolved over time.

Lotus Notes/Lotus Domino

     We were most fortunate to have as the technological basis for our community, the Lotus Notes (and later, when the server was renamed, Lotus Domino) products.  Since this premiere example of "groupware," there have been many other products introduced, none as rich or as versatile.

     The concepts behind Notes were based on facilitating human communication.  The product's creator, Ray Ozzie, had used an on-line threaded discussion system at the University of Illinois, which had been conceived and implemented by David Woolley; you can learn about that predecessor to Lotus Notes in David's writings, especially "How I Invented Computer Conferencing."

     Of all the features of Notes that the Forum exploited, however, there is one that made much possible, and it's a feature that still no competitor has perceived as significant:  Templates.  Instead of having a hard-wired design, each and every Lotus Notes database carries it's design in a template, which can be changed without losing any of the existing data.  Because data is managed in an internal object-oriented store, it survives independently of the specific template applied.  That allowed us to experiment with different design features without disrupting the on-going process of community creation, because individuals could try out new design ideas without affecting the entire population.

     Other intrinsic features of Notes/Domino that are used by Lotus, Lotus Notes Network, and individual Business Partners include:

Feature Description
Messaging The ability to automatically send and receive e-mail messages
Replication The ability for each individual server in a Notes network to maintain a local replica of each database (e.g., the Forum)  A replica differs from a copy in that each instance of the database is logically identical to others (if no selective replication is used), but the physical on-disk layout may be significantly different from site to site.  Only changes are transmitted between computers.
Security Unique IDs are used to allow access only by authorized parties
Connectivity Modem and Internet connections are supported, which allows each Business Partner to select the most economical means to replicate the Forum database.
Scalability Lotus Notes Network maintains a phalanx of Domino servers to support the Forum and all the other databases LNN delivers to its customers.
Technology is
a facilitator, not
the prime mover.
Caution to techies:
What you DO is
more important
than what you
USE.

Notes/Domino Version History

     Lotus Notes has been through several major revisions since it's commercial birth in 1987.  With each new release, Lotus' product has both improved, and gained wider adoption by customers.  Major releases (R2, R3 ...) typical represent major changes in features and functionality (for example, with R4 came group calendaring and scheduling built into the e-mail template).  "Point" releases represent improvements, enhancements and bug fixes.  Since 1996, these point releases have generally been produced quarterly, and called Quarterly Maintenance Releases (QMR), not every one of which are identified in the following table:

Release Description
R2 First "popular" release of Notes
R2.1 Enrichment of feature set; basis for the Forum
R3 Radical redesign of internal functionality
R3.1
R4 Dec '95 Major redesign, User Interface, WWW support
R4.1
R4.5 Dec '96 Major improvements in functionality of R4
R4.6 Aug '97 Major additions to features, functionality
R5 est. mid-98


Hardware Technology

     Despite the lofty title, the very first "Notes Net" was a borrowed computer under the desk of Francois Koutchouk at Lotus.  At the time, he had the riches of four (count 'em, four) 9600-baud modems...which is how Scott Brown came to be connected with the nascent service.

     The server became a permanent fixture, and had to be expanded to more servers maintained by the Lotus Information Services (IS) organization to keep up with the growing population of users and applications.  That put the computer and communications technology on more solid footing, with backups, emergency power, and a support staff.  And, the number of databases accessible to the BP continued to grow beyond the Forum itself.

     Then, in May, 1995, "Notes Net" was formalized as "Lotus Notes Network" (LNN), a new service to provide support for the growing set of BP on-line services. and to develop a delivery channel for new information products to the customer base.  That commercial operation continued to operate under professional management until early 1998, when LNN's mission changed, and the operational part of its responsibilities were assumed again by the IS organization.

Actual support and
maintenance has
grown with traffic.


Discussion Database Design

     The original "Partner Forum," introduced in mid-1991, used the then-current Discussion Database template distributed with Lotus Notes R2.1.  That provided the basic capabilities (threaded discussions, categorization, alternate views, etc.), but it had few content controls.  For example, while the user's name was filled into the Author field, it was left editable, so individuals could change that name for publication.  Fortunately, the original author's name was also carried in the document, so we could resolve the masquerade to a particular person if necessary.

     In mid-1994, the original Forum was getting huge; it topped out over 100 MB when it was retired.  There was some need for more organization of contents and more control over participant identities, and a contractor working for Lotus apparently modified a standard R3.1 Discussion template.  Insofar as I know, no members of the Forum were consulted about the design, and many of the features introduced in that design were never used (e.g., separate forms for different kinds of issues).


Technology Enhancements

     In the Autumn of 1995, at the urging of several of the Forum members, the discussion about the design of the discussion database was turned into a simple database of its own.  That relieved the general population from being exposed to the details of that dialog, and clearly focused attention by those interested on the issue.  However, having started the "discussion about discussion design," Lotus virtually abandoned it, and made no plans to implement any of the ideas.

     As we discussed earlier, Alex Wilson designed a new Forum in 1996, and he produced a radical departure from the off-the-shelf Discussion templates offered by Lotus with its product.  Working from his experience as a Core Regular, Alex designed, implemented and tested:

Profiles:  Additional documentation beyond individual names, including e-mail address, phone numbers, address.  Each participant was encouraged to fill out a profile, and each post they made pointed to that profile, openable with a mouse-click.
 
PostType:  Prior to this time, each message had a Title and Category, and views by Category (so similar threads appear adjacent), by Date and by Author.  With PostType, certain classes of messages could be separated out:  Wishlist items, Possible Bug Reports, Votes for/against various Wishlist items.  A message may have one or more PostTypes, selected from a list.
 
Institutionalized the use of the "*" and ">" flags for one-liners and "fluff".  If the post started with "*", for instance, the PostType was set to include "One-liner".   That way, people not interested in these kinds of messages could easily change the local design of their own replica of the database to never accept them.
 
Removed a major problem with naive users "copying and pasting."  When any user of a replica of the database posts a document, that change is replicated to LNN, then out to thousands of other servers throughout the world.  Until this design, a user could select a few hundred documents, copy them, and inadvertently paste them back into the Forum.  Then, their mistake would be propagated to every other replica throughout the world.  The new design marked these duplicates in a special way so that LNN never accepted them, thus preventing the mistake from propagating.
 
Introduced "Author Editing."  The original Author of a document was now offered the ability to edit that document ('tho not delete it altogether).  This avoided some of the problems of having errata posted way down inside a thread, where they might be missed.
 
Clear use of response hierarchy.  There are some technical confusions between "Response" and "Response to Response" in Lotus Notes; Alex simply solved that problem by eliminating the former message type.
 
Large Objects separation.  Large Objects were separated out to a new database, to avoid cluttering the Forum and making the Forum database too large to conveniently carry on a laptop computer.
 
Adoption of R3 functionality.  The Forum has tended to rely on features only a year or more old, to accommodate those participants who upgrade their "production" servers only infrequently.  By the time Alex did his work, R3 was a stable, widely adopted platform.

     By early '96, the need for a new database was evident.  There were lots of wishes for changes in design, and we then past 25,000 posts.  On his own initiative, Alex Wilson, one of the more prolific members of the community, designed a whole new database and circulated it to willing peers for experimentation.  Lotus supported the effort by opening a whole new discussion, called "Forum Design Discussion."

     In an exercise of Urgency over Importance, Alex's design was appropriated and the deployment bungled.  Lotus had made the decision to add Worldwide Partners to the Forum, which had heretofore been accessible largely to North Americans.  Contract programmers at Lotus, responding to the demands of their customer, were in a great hurry to deploy something.  Without consulting the participants in the "Forum Design Discussion," they appropriated Alex's design and severely damaged it, removing many of the features they deemed too time-consuming to implement.  The resulting corrupt design was hash, and it was deployed several successive times, confusing everyone in the Forum in the process.  In retrospect, it would have been better for all parties to continue on the collaborative path and arrived at a comprehensive design to suit all the parties.  As it was, the "rush" job deployment was first attempted in March, 1996...but practical use did not occur for another four months.

     Despite the bungled deployment of Alex's "BP Technical Forum 96" design, his design became the basis for Mike Woolsey's subsequent work for this Forum, and several other discussion database designs within the Lotus Business Partner Program.  It is a landmark design that has stood the test of time...and subsequent evolution.

Continued Evolution

     Some of the features that Mike Woolsey has added to subsequent iterations of the design include:

Expiration Dates:  After deliberation of my original idea, Mike implemented a technique of computing an "Expiry Date" for each document, which anyone could change in their local copy.  Nominally 90 days after post, the expiration date allows individual items to be opened and marked with any other duration.  That means the database can be automatically purged of the on-going dialog, but key and significant threads can be saved indefinitely...and that decision is made locally by each individual owner of a replica.
 
E-mail any author:  Using the Profile, the reader can post an e-mail response with the click of a button.
 
Interest profiles:  Allow individual users to specify keywords that, when detected in incoming posts will flag those documents for personal attention.
 
Newsletter:  Using the Interest profile and new Notes R4 functionality, implements an optional daily Newsletter that summarizes Forum messages that may be of interest.
 
Adapted design to R4 User Interface:  R4 added the concept of Action Buttons above a view; these were added to the database to make common activities easier to select.
 
Bulletproofing:  Significant improvements to make appropriate behavior easier to enforce, by preventing inappropriate behavior in the design.
Enriched handling of Probable Bug Reports:  Added functionality to make it easier for Lotus to manage these documents on their side, resulting in better interface to existing internal systems, and better "closure" rate with the participating Partners.

     Throughout, Mike has good-naturedly responded to numerous requests for cosmetic tweaks and enhancements.

Unique Forum-specific
design emerged in
1996 with a break-
through design that
endures to this day.


Managing Forum Transitions

     Some of the logistics in getting so many interested parties to collaborate in changing from one Forum design to the next have proved more complex that they might appear at first glance.  The first two such transitions were months in the process, with most changeovers taking place over a two-month period...but with several months before when no one was certain which Forum was active.

     Once the design stabilized in 1996, subsequent transitions have been quicker and better managed.  That's because the operations professionals at LNN now know how to properly install and use the Forum database design.  And, changes to that design can be tested on "live" on-going discussions by individual users to debug them before they're turned over to Lotus for deployment.

     In February 1998, the actual transition took less than one month... although a few latecomers still seem to post to the now-dormant "BP Technical Forum '97."  We probably can't control that, but some Core Regulars keep tabs and e-mail those people that their questions are more likely answered from the active Forum.

 

Back Home Up

From http://www.deepwoods.com    Copyright © 1997-2002 Deep Woods Technology, Inc.
Send mail to webmaster@deepwoods.com with recommendations, questions or comments about our web site.
Last modified: March 13, 1998   (Hit Counter )