|
Technology's Influence on Community
Lotus Notes and Adaptability to Needs
|
|
Abstract: An seven-year experience in
development of an on-line community among Lotus' Business Partners ("the Forum")
was, naturally enough, based on Lotus Notes and Domino. However, the
technologically-advanced population leveraged their expertise and skill to uniquely modify
and adapt the technology to suit their needs, as they evolved over time. |
|
|

|
Lotus Notes/Lotus Domino
We were most fortunate to have as the technological basis for
our community, the Lotus Notes (and later, when the server was renamed, Lotus Domino)
products. Since this premiere example of "groupware," there have been many
other products introduced, none as rich or as versatile.
The concepts behind Notes were based on facilitating human
communication. The product's creator, Ray Ozzie, had used an on-line threaded
discussion system at the University of Illinois, which had been conceived and implemented
by David Woolley; you can learn about that predecessor to Lotus Notes in David's writings,
especially "How I
Invented Computer Conferencing."
Of all the features of Notes that the Forum exploited,
however, there is one that made much possible, and it's a feature that still no
competitor has perceived as significant: Templates. Instead of having a
hard-wired design, each and every Lotus Notes database carries it's design in a template,
which can be changed without losing any of the existing data. Because data is
managed in an internal object-oriented store, it survives independently of the specific
template applied. That allowed us to experiment with different design features
without disrupting the on-going process of community creation, because individuals could
try out new design ideas without affecting the entire population.
Other intrinsic features of Notes/Domino that are used by
Lotus, Lotus Notes Network, and individual Business Partners include:
|
Feature |
Description |
|
Messaging |
The ability to automatically send and receive e-mail messages |
|
Replication |
The ability for each individual server in a Notes network to maintain a
local replica of each database (e.g., the Forum) A replica differs
from a copy in that each instance of the database is logically identical to others (if no
selective replication is used), but the physical on-disk layout may be significantly
different from site to site. Only changes are transmitted between computers. |
|
Security |
Unique IDs are used to allow access only by authorized parties |
|
Connectivity |
Modem and Internet connections are supported, which allows each Business
Partner to select the most economical means to replicate the Forum database. |
|
Scalability |
Lotus Notes Network maintains a phalanx of Domino servers to support the
Forum and all the other databases LNN delivers to its customers. |
|
|
Technology is
a facilitator, not
the prime mover.
Caution to techies:
What you DO is
more important
than what you
USE. |
|
Notes/Domino Version History
Lotus Notes has been through several major revisions since
it's commercial birth in 1987. With each new release, Lotus' product has both
improved, and gained wider adoption by customers. Major releases (R2, R3 ...)
typical represent major changes in features and functionality (for example, with R4 came
group calendaring and scheduling built into the e-mail template). "Point"
releases represent improvements, enhancements and bug fixes. Since 1996, these point
releases have generally been produced quarterly, and called Quarterly Maintenance Releases
(QMR), not every one of which are identified in the following table:
|
Release |
|
Description |
|
R2 |
|
First "popular" release of Notes |
|
R2.1 |
|
Enrichment of feature set; basis for the Forum |
|
R3 |
|
Radical redesign of internal functionality |
|
R3.1 |
|
|
|
R4 |
Dec '95 |
Major redesign, User Interface, WWW support |
|
R4.1 |
|
|
|
R4.5 |
Dec '96 |
Major improvements in functionality of R4 |
|
R4.6 |
Aug '97 |
Major additions to features, functionality |
|
R5 |
est. mid-98 |
|
|
|
|
|
Hardware Technology
Despite the lofty title, the very first "Notes Net"
was a borrowed computer under the desk of Francois Koutchouk at Lotus. At the time,
he had the riches of four (count 'em, four) 9600-baud modems...which is how Scott Brown came to be connected with the nascent
service.
The server became a permanent fixture, and had to be expanded
to more servers maintained by the Lotus Information Services (IS) organization to keep up
with the growing population of users and applications. That put the computer and
communications technology on more solid footing, with backups, emergency power, and a
support staff. And, the number of databases accessible to the BP continued to grow
beyond the Forum itself.
Then, in May, 1995, "Notes Net" was formalized as
"Lotus Notes Network" (LNN), a new service to provide support for the growing
set of BP on-line services. and to develop a delivery channel for new information products
to the customer base. That commercial operation continued to operate under
professional management until early 1998, when LNN's mission changed, and the operational
part of its responsibilities were assumed again by the IS organization. |
|
Actual support and
maintenance has
grown with traffic. |
|
Discussion Database Design
The original "Partner Forum," introduced in
mid-1991, used the then-current Discussion Database template distributed with Lotus Notes
R2.1. That provided the basic capabilities (threaded discussions, categorization,
alternate views, etc.), but it had few content controls. For example, while the
user's name was filled into the Author field, it was left editable, so individuals could
change that name for publication. Fortunately, the original author's name was also
carried in the document, so we could resolve the masquerade to a particular person if
necessary.
In mid-1994, the original Forum was getting huge; it topped
out over 100 MB when it was retired. There was some need for more organization of
contents and more control over participant identities, and a contractor working for Lotus
apparently modified a standard R3.1 Discussion template. Insofar as I know, no
members of the Forum were consulted about the design, and many of the features introduced
in that design were never used (e.g., separate forms for different kinds of issues). |
|
|
|
Technology Enhancements
In the Autumn of 1995, at the urging of several of the Forum
members, the discussion about the design of the discussion database was turned into a
simple database of its own. That relieved the general population from being exposed
to the details of that dialog, and clearly focused attention by those interested on the
issue. However, having started the "discussion about discussion design,"
Lotus virtually abandoned it, and made no plans to implement any of the ideas.
As we discussed earlier, Alex Wilson
designed a new Forum in 1996, and he produced a radical departure from the off-the-shelf
Discussion templates offered by Lotus with its product. Working from his experience
as a Core Regular, Alex designed, implemented and tested:
|
 | Profiles: Additional documentation beyond individual
names, including e-mail address, phone numbers, address. Each participant was
encouraged to fill out a profile, and each post they made pointed to that profile,
openable with a mouse-click.
|
 | PostType: Prior to this time, each message had a Title and Category, and views by
Category (so similar threads appear adjacent), by Date and by Author. With PostType,
certain classes of messages could be separated out: Wishlist items, Possible Bug
Reports, Votes for/against various Wishlist items. A message may have one or more
PostTypes, selected from a list.
|
 | Institutionalized the use of the "*" and ">"
flags for one-liners and "fluff". If the post started with
"*", for instance, the PostType was set to include "One-liner".
That way, people not interested in these kinds of messages could easily change the local
design of their own replica of the database to never accept them.
|
 | Removed a major problem with naive users "copying and pasting." When any
user of a replica of the database posts a document, that change is replicated to LNN, then
out to thousands of other servers throughout the world. Until this design, a user
could select a few hundred documents, copy them, and inadvertently paste them back into
the Forum. Then, their mistake would be propagated to every other replica throughout
the world. The new design marked these duplicates in a special way so that LNN never
accepted them, thus preventing the mistake from propagating.
|
 | Introduced "Author Editing." The original Author of a document was now
offered the ability to edit that document ('tho not delete it altogether). This
avoided some of the problems of having errata posted way down inside a thread, where they
might be missed.
|
 | Clear use of response hierarchy. There are some technical confusions between
"Response" and "Response to Response" in Lotus Notes; Alex simply
solved that problem by eliminating the former message type.
|
 | Large Objects separation. Large Objects were separated out to
a new database, to avoid cluttering the Forum and making the Forum database too large
to conveniently carry on a laptop computer.
|
 | Adoption of R3 functionality. The Forum has tended to rely on features only a year
or more old, to accommodate those participants who upgrade their "production"
servers only infrequently. By the time Alex did his work, R3 was a stable, widely
adopted platform. |
|
By early '96, the need for a new database was
evident. There were lots of wishes for changes in design, and we then past 25,000
posts. On his own initiative, Alex Wilson, one of the more prolific members of the
community, designed a whole new database and circulated it to willing peers for
experimentation. Lotus supported the effort by opening a whole new discussion,
called "Forum Design Discussion."
In an exercise of Urgency over Importance,
Alex's design was appropriated and the deployment bungled. Lotus had made the
decision to add Worldwide Partners to the Forum, which had heretofore been accessible
largely to North Americans. Contract programmers at Lotus, responding to the demands
of their customer, were in a great hurry to deploy something. Without
consulting the participants in the "Forum Design Discussion," they appropriated
Alex's design and severely damaged it, removing many of the features they deemed too
time-consuming to implement. The resulting corrupt design was hash, and it was
deployed several successive times, confusing everyone in the Forum in the process.
In retrospect, it would have been better for all parties to continue on the collaborative
path and arrived at a comprehensive design to suit all the parties. As it was, the
"rush" job deployment was first attempted in March, 1996...but practical use did
not occur for another four months.
Despite the bungled deployment of Alex's "BP Technical
Forum 96" design, his design became the basis for Mike Woolsey's subsequent work for
this Forum, and several other discussion database designs within the Lotus Business
Partner Program. It is a landmark design that has stood the test of time...and
subsequent evolution.
Continued Evolution
Some of the features that Mike Woolsey has added to subsequent
iterations of the design include:
|
 | Expiration Dates: After deliberation of my original idea, Mike implemented a
technique of computing an "Expiry Date" for each document, which anyone could
change in their local copy. Nominally 90 days after post, the expiration date allows
individual items to be opened and marked with any other duration. That means the
database can be automatically purged of the on-going dialog, but key and significant
threads can be saved indefinitely...and that decision is made locally by each individual
owner of a replica.
|
 | E-mail any author: Using the Profile, the reader can post an e-mail response with
the click of a button.
|
 | Interest profiles: Allow individual users to specify keywords that, when detected
in incoming posts will flag those documents for personal attention.
|
 | Newsletter: Using the Interest profile and new Notes R4 functionality, implements
an optional daily Newsletter that summarizes Forum messages that may be of interest.
|
 | Adapted design to R4 User Interface: R4 added the concept of Action Buttons above
a view; these were added to the database to make common activities easier to select.
|
 | Bulletproofing: Significant improvements to make appropriate behavior easier to
enforce, by preventing inappropriate behavior in the design.
|
 | Enriched handling of Probable Bug Reports: Added functionality to make it easier
for Lotus to manage these documents on their side, resulting in better interface to
existing internal systems, and better "closure" rate with the participating
Partners. |
|
Throughout, Mike has good-naturedly responded to
numerous requests for cosmetic tweaks and enhancements. |
|
Unique Forum-specific
design emerged in
1996 with a break-
through design that
endures to this day. |
|
Managing Forum Transitions
Some of the logistics in getting so many interested parties to
collaborate in changing from one Forum design to the next have proved more complex that
they might appear at first glance. The first two such transitions were months in the
process, with most changeovers taking place over a two-month period...but with several
months before when no one was certain which Forum was active.
Once the design stabilized in 1996, subsequent transitions
have been quicker and better managed. That's because the operations professionals at
LNN now know how to properly install and use the Forum database design. And, changes
to that design can be tested on "live" on-going discussions by individual users
to debug them before they're turned over to Lotus for deployment.
In February 1998, the actual transition took less than one
month... although a few latecomers still seem to post to the now-dormant "BP
Technical Forum '97." We probably can't control that, but some Core Regulars
keep tabs and e-mail those people that their questions are more likely answered from the
active Forum. |
|
|
|