ELISAD European Gateway on Alcohol and other Drugs / Final Research and Activity Report December 2003 
back to table of contents

3. Results.

3.1. Content of the gateway catalogue

This chapter provides an overview of quantitative results in the data collection process, and a subsequent analysis of geographical distribution, subject coverage and data quality.

3.1.1. Overview of European AOD websites identified, reviewed and catalogued

The results of the website identification process (see 2.2.2.) are currently including a total number of 1267 websites (state 9/2003). Compared to the initial estimate (cf. Stockholm meeting 9/2001), the number of websites has undergone a vast growth given the successive identification of URLs in the research process. During 24 months, a growth rate of 100,4 % has been observed for the European AOD website landscape.

Interim results (9/2002) from the selection process correspond to 784 websites (see Annex 1). It has been expected that this number would change during the following months of the continued data collection process. Nevertheless, the enormous growth rate observed has largely overpassed the initial expectations. Consequently, the task of data collection became a challenge in terms of time and personnel resources of the project participants.

The following overview of websites identified during the project duration phase from February 2002 to September 2003 shows the relations of countries, growth, data cataloguing and de-selection of websites from the gateway.

The project objective was to establish a basis dataset on AOD websites from all European countries. Given the complexity of several website contents and the extensiveness of information to be described, participants report an average time amount of 2 hours per record. Since the vast growth of data has largely overpassed the group´s capacity to create full descriptions/records, a modus had to be invented in order to include all suitable websites identified during the research process. The group agreed in the Utrecht meeting to list these additional websites as "in progress" files to the catalogue (see Annex 17, meeting minutes). For these websites, the title, publisher, URL, and country have been registered to the catalogue with the remark "in progress" in the major keywords field. These websites can be obtained by browsing the "new" section of the gateway website. They are not displayed in the subject browsing of the gateway, unless no detailed information about their content is recorded.

data collection overview table (state 9/2003)

à 1140 AOD websites have been evaluated during the research process
à 824 websites have been recorded to the gateway catalogue
à 127 known websites have not undergone revision and subsequent inclusion/ exclusion, especially from France and french Switzerland, and will be included to the next phase of the gateway project.

Evidence for a fast growth in the AOD website landscape is indicated by the large numbers of newly identified AOD websites that have emerged from 2/2002 until 9/2003. Within a time frame of 21 months, 552 new websites in total have been identified until 9/2003, or 77,2 % compared to the 715 websites known in 2/2002.

This significant growth rate underlines the relevance of the gateway tool for professionals, as well as the necessity of continous cataloguing.

Out of the 715 websites identified at the start of the project in February 2002, a total number of 552 full descriptions have been achieved, according to 77,2% of the initial sample (n=715). The project objective to create a basic set of data on AOD websites has thereby been achieved. An additional 272 websites have been listed "in progress", according to 38 % of the original sample and 33 % of the total number of records included.

In total, 824 records have been added in the gateway catalogue, according to 117 % of the initial estimate. Thereby, the group has not only achieved the project objective but even overpassed their work scope by far.

Out of the 1267 websites known by the end of the project work programme in September 2003, a total number of 1140 websites from 32 contries have been reviewed. For 48,4 % of these, full records have been produced, and 23,9 % have been listed. Another 27,7 % have been de-selected from the gateway catalogue.

3.1.2. De-selected AOD websites

A total number of 316 AOD websites have been de-selected for various reasons, corresponding to a percentage of 44,2 % compared to the 2/2002 listing (n=715) and 24,9 % in comparison with the 9/2003 listing (n=1267). In order to prevent future work duplication, the "black list" of rejected websites has been published on the elisad.uni-bremen.de server with a password protected access (cf. Annex 20).

Various reasons for rejection have been noticed by the data collectors team. These included:

• poor content (136), meaning no substantial information on AOD matters available, basic information missing (e.g. publisher/author evidence), or functionality not working
  
• no more available / disappeared (79), meaning 404 errors encountered or inaccessibility of the domain
  
• out of scope (59), meaning the website contains no AOD related content, or too general contents, e.g. on health, or is out of the geographical scope of a participant
  
• not updated (21), meaning the website content is outdated and older than 18 months
  
• language barrier (11), meaning the website content was not understandable by the participants for language reasons or not readable, e.g. written only in cyrillic letters
  
• new URL (12), meaning the same website has changed the domain and is no longer published under the old URL
  
• publisher restricts inclusion (3), meaning a website publisher has expressed his unwillingness to be listed in the gateway catalogue towards the participant responsible
  
• deeplink (14), meaning the listed URL indicates a part of an already described or listed website.

Taken together the figures for disappeared, outdated and no more relevant URLs of sites which have changed their web address, a total of 112 websites are no more available at the original address over a time frame of 21 months, meaning a percentage of 15,66 % from the original sample (2/2002, n=715).

These results give evidence for a significant fluctuation rate, indicating the dynamic changes in the AOD website landscape through Europe.

Another 195 websites, corresponding to 27,27 % of the 2/2002 listing (n=715) have been excluded from the catalogue for content related reasons.

3.1.3. Geographical coverage and distribution of catalogue records

In the project application (2001), the geographical scope planned for data collection covered websites from 20 countries. AOD websites identified at the project start (2/2002) pertain to a geographical coverage including 22 countries, whereas results at the end of the project in 9/2003 include a coverage of 32 countries, next to pan-european and international AOD websites. Thereby, the project results have overpassed the formerly estimated geographical scope by far.

The following analysis of the geographical distribution of records includes all 824 records produced, including full records (552) and in progress files (272). The results include 16 European Union member states, and 16 Non-EU member countries, next to the categories "Europe" and "International". Within the gateway catalogue content, the representation of European countries in terms of AOD websites described shows significant differences.

For several western European countries, mainly European Union members, a broad range of records are available. Reasons might relate to the origin countries of the data collecting project participants and an accordingly better language understanding compared to other countries.

well represented EU countries

For other European countries, a comparably smaller amount of websites was identified and described, resulting in smaller amounts of catalogue records available. Assumed reasons may be not only the smaller size of these relatively weak represented countries, but also a more limited language access by data collecting participants involved. In this sample, some European Union accession countries are included.

weak represented EU/accession countries

In complement to the countries covered, data have been collected for AOD websites with a Pan-european and International scope of activities, aiming to include and provide information on the relevant European bodies in the AOD field.

representation of pan-european and international AOD websites

Relation of EU countries and Central / Eastern European countries

In the case of websites from the Central and Eastern European countries (CEECs), two participants (SZU/BISDRO) were responsible for identification and recording of AOD websites. Further URLs have been proposed by CEECs drug experts from the National Focal Points (NFPs) cooperating with the EMCDDA in the framework of the REITOX network and Phare Multibeneficiary Drugs Programme during the training conducted in September 2002 (cf. 2.5.3. and Annex 13). Given the joint field-specific knowledge of this pool of AOD experts, the suggestions can be rated of high quality level in general. The creation of catalogue records was part of the training with a result of 10 descriptions in total.

Nevertheless, it was difficult for the data collecting project participants to complete additional records due to limited language knowledge for most of the CEECs countries. Given that the language barrier is the most striking problem to access AOD related information on the www, there is significant evidence for further need of research, website tracking and data collection together with the necessity for a future extension of the project group to include more participants from the CEECs.

representation of CEECs

In general, there are relatively few AOD related websites available in most of the CEECs, as compared with the European Union countries. In order to explain these results, it may be assumed that this reflects the state of arts in the CEECs concerning the level of use of eletronic documentation practices and levels of involvement into the digital environment of the www, and the still developing level of networking of these countries, mirrored in the internet presence of AOD institutions. Given that an according development towards the enhanced use of electronic means can be expected in the next few years, the gateway project has to find contributors and resources to cope with the subsequent increase of AOD websites in Central and Eastern Europe.

3.1.4. Subjects coverage of catalogue records

In the gateway website, the catalogue content is presented to the user according to thematic browsing categories, keywords, and result filters (see 3.2.) Analysing the catalogue content scope according to subjects, the 552 available full records include meta-information on 9 main AOD topics, and additional data on populations, environments and types of resources. Recording information about these thematic areas is facilitated by the subject sections on the input form (cf. 2.2.3 and Annex 4), according to the thematic contents of each website described.

The number of records listed below corresponds to the results obtained when any of the below topic categories is browsed. The number of resulting records corresponds to the full records available in the catalogue. Since several websites provide information on more than one subject, these are listed in one or more main subject categories.

table: topics of websites included according to main browsing categories / full records n = 552

It can be assumed that the gateway data reflects current trends in AOD related topics, and current concerns with prevention, treatment, research, and policy can be observed within the website landscape in the field of AOD. Accordingly, cross-European relevance of these subjects can be derived from the gateway data.

Presumed that the internet is an accurate mirror of topics of interest, it is suitable that the ¾ majority of AOD websites provide substantial information on prevention related matters (75,7%). A large proportion of websites provide information about psychoactive substances (65,9%), addiction related topics (64,3%) and consequences of drug use (56,3%).

Next to these BIG themes, around ½ of the websites included deal with issues related to AOD treatment and services (46,1%), and/or AOD policy (47,1%), while 1/3 provide information about AOD related research matters (33,3%).

According to the catalogue content, less popular themes within websites are history and culture (25,3%), or matters related to AOD economics and trafficking (18,3%).

Complementing this very general perspective, the gateway catalogue is able to provide a more in depth look into single topics which form parts of the overall main topics discussed above. The number of records correspond to the results obtained when any of the below keywords is chosen in its major browsing category of the online catalogue. Where appropriate, major subject categories were split up to more differentiated sub-categories.

Below, a selection of examples of well and weakly represented sub-topics are provided for each thematic section, in order to give an exemplary overview of the catalogue content in relation to the thematic keywords.

It is expected that the below figures will change soon. Since the 552 full records available by the end of the project work programme represent only a part of the AOD related website landscape through Europe, pertaining to a percentage of 66,9% of all 824 websites included which are successively to be completed in the future, they are only able to provide partial and momentary insight into the cross-Eurpean status of AOD topics on the web as analysed in this chapter.

Prevention and education represents the largest category of in terms of websites recorded, including 14 keywords. Among these, secondary prevention (39,9%) shows up to be the most frequent subject of AOD websites included to the catalogue, closely followed by harm reduction matters (33,9%) and web based information about primary prevention (33%) including a large range of preventive interventions. This may indicate a shift of leading paradigms from generally abstinence oriented objectives towards aims directed at reduction of problematic and/or harmful behaviour, or as well express a tendency of complementary and combined approaches performed across Europe, whereas significantly less information is addressing tertiary prevention (13,8%).

Besides, educational matters such as health education (52,3%), trainings (39,4%) or conferences and lectures (28,7%) are well represented within European AOD websites. A refinement of all records available in the category prevention, applying the result filter for the environment "school" offers 108 hits (43%), which may reflect the variety of cross-European efforts to implement preventive efforts within several educative contexts.

The category psychoactive substances includes a total of 31 keywords, split up to specific substances (17), generic terms (10) and substance related keywords (5).

As indicated by the data, 364 websites inform about specific substances, but the main concern of website contents are alcohol (64,5%), cannabis (54,9%), ecstasy (48,3%), heroin (47,2%) and tobacco (41,2%). Measured in terms of web based information, activities and interests in most European countries are focused on these drugs, obviously considering problems related to both legal drugs of major import, whereas concern about the illegal drugs cannabis and heroin reflect a widespread longterm interest, adjuncted by ecstasy as a more recent cross-European trend, closely followed by LSD (37%). Compared to these figures, methadone finds itself relatively weakly represented in 21,9% of all records in this category.

This observation is confirmed within the web based information about substance groups, available in 70,8% of records in this category: large proportions of AOD website contents inform about opiates, hallucinogens and party drugs. Other relevant topics in this sub-category are prescription drugs (38,3%), inhalants (37,9%) and, with a less extensive proportion, doping substances (24%).

Information about substance related issues form 37% of this category. Among these, dosage/overdose matters (78,5%) and quality/purity related issues (31,8%) are most featured topics.

The subject category substance use and addictive behaviours includes 22 keywords, split up in terms related to consumption of drugs (16) and behavioural addictions (6). Out of the 355 records in this category, it is evident that information about AOD related addiction matters are most often provided within the website contents, whereas behavioral addictions pertain to a proportion of 19,7%, while a content related overlap of websites focusing on both matters versus a minority of sites directed at specific behavioral addictions have to be considered.

The majority of websites feature information on dependency as a main concern (69,2%), while cessation (25%) and abstinence (21,9%) are addressed in significantly less extent. In comparison with the topics related to patterns of substance use, information about specific subjects like e.g. medical marijuana (5,9%) is limited to a smaller number of specific websites.

Among the websites regarding behavioural addictions, gambling (71,4%) is represented more frequently than other subjects, such as e.g. eating disorders (48,5%).

The category consequences and effects is split up to 3 sub-categories, including 14 keywords on health consequences, 10 keywords on social consequences, and 7 keywords describing drug effects. Out of all records in this section, the largest proportion of websites contain information about health related matters, varying between single topics such as AIDS (30,8%), drug related death (43,4%), or pregnancy (28,9%).

Another 70% of AOD websites inform about social matters. Within this sub-category, information about general social consequences (53,6%) is most frequent, and driving related matters (35,4%) are well represented, while web information about crime (22,7%) occurs to be provided less frequently.

A significantly smaller proportion of 28,6% is providing information about psychological drug effects. Among these, drug effects such as consciousness alteration (74,1%) and performance (50,5%) are more likely to be found on the web compared to creativity (37%).

The category policy includes 13 keywords on specific topics. Most of the 260 websites listed in this category deal with law / legislative matters (63,8%) and control directed to AOD (38%). Comparably few websites provide information on decriminalisation and AOD legislation efforts (20,3%), international cooperation (17,3%) or about non-governmental political initiatives of citizens (15,3%).

These data sustain the assumption that web based information about AOD policy is mostly manifested by legislative efforts across Europe, aiming to control the demand for drugs.

A very differentiated variety of website contents is recorded in the category treatment and services, including 32 keywords, which was therefore split up into the sub-categories treatment (22) and help/services (10). Out of the 254 websites listed in the first section, information about residential treatment (44,4%) is most frequently provided, followed by rehabilitation (38,9%) and detoxification (35,4%). Websites dealing about substitution (31,1%), self help (29,9%), psychotherapy (27,9%) and aftercare (27,1%) are well represented. Less information is available about pharmacotherapy (22%), alternative approaches (19,6%) and heroin maintenance (13,3%).

Information about help and services are most likely to describe counselling offers (70,6%). Other frequent issues are psychosocial care (32%), and outreach work (22,3%). Less frequently, AOD websites provide information about low threshold services (17,6%), emergency facilities (12%) or injection rooms (6,5%).

According to these data, interventions such as residential treatment and counselling prove to be the most widespread approaches through Europe, while new trends towards heroin maintenance and injection rooms are currently limited to few pilot offers.

To ensure subject oriented retrieval, the category research was split up into approaches, including 13 keywords, and disciplines, including 14 related keywords. With an overlap of near 100%, all reseach related websites have been recorded in both categories. This allows an insight into the preferate strategies to scientifically approach AOD related topics.

Among the approaches, information about epidemiology (52,7%) and evaluation (46,7%) is most frequently available. Theory (24,4%) and evidence based approaches (23,9%) are well represented, whereas comparative studies (20,6%), qualitative methods (20,6%) and gender approaches (18,4%) have a significantly weaker representation, followed by experimental research (16,8%).

Disciplines involved in AOD research are mainly presented as health in general (54,9%), or included to the social sciences (54,3%), followed by activities in the fields of medicine (33,5%), or in multidisciplinary approach (33,3%). Significantly less information is available about psychiatry (17%) and the neurosciences (10,9%), while geopolitics (6,5%) and ethnology (6%) occur to have an even weaker representation within the European website landscape.

The category history and culture includes 10 fixed keywords. Websites with a thematic focus on cultural aspects of AOD are more likely providing information about historical backgrounds (45%) and subcultural contexts (29,2%), featuring drug users knowledge (25,7%) as a unique resource for research, prevention and treatment in AOD. Less information is available about AOD use in traditional or religious context (16,4%). Even weaker representation can be observed for art (11,4%), films (9,2%) and other cultural products.

According to these data it can be assumed that this section is more likely to include private websites produced within the AOD users community, representing their wish to distribute and exchange information about their culture and experiences. A small number of institutional publishers is concerned with adjuncted cultural products serving to support prevention and professional approaches towards AOD.

The category economics and trafficking includes 18 keywords. Most AOD websites recorded within this topic provide information about illicit trafficking and smuggling (39,6%). Other frequent concerns are health economics (33,6%), the production of substances (28,7%), and information regarding AOD marketing and advertising (26,7%). Comparably few information is available on topics such as agriculture (14,8%) and industry (13,8%).

Being the thematic category with the smallest number of records, it must be assumed that information related to AOD economics occurs to be a theme of minor interest through Europe, or that information related to specific subjects in this area is usually not prone for publishing on the internet.

Complementing the major subject categories and sub-topics analysed above, additional metadata has been recorded about populations, settings and types of resources. These items define information about environments and target groups of prevention and treatment, or research populations and settings provided in context with the above mentioned website topics. To facilitate the needs of professional gateway catalogue users, the types of online information available on each AOD website have been indexed.

Records in these 3 categories are not displayed as own topic categories for browsing but serve as results filters. Information to the according keywords can be obtained by browsing either any subject category, or the complete catalogue content (cf. 3.2.3) and then limiting the result by a chosen keyword using the pulldown menues at the right side of the screen. Examples for records indexed in these 3 filter sections are enumerated below.

The above data about populations indicate to which groups the subjects refer to, including information about target groups of prevention and treatment, or research populations. Most frequent audiences are young people (47,4%), adolescents (41,1%) and children (22,4%). Another large group are health professionals themselves (33,6%) in relation with their working contexts. Parents (25,9%) and teachers (19,2%) are often subject to AOD website matters, while specific populations such as women (14,4%), smokers (6,8%) or prisoners (6,5%) are less represented within the AOD website contents through Europe.

It is evident that youth, being considered as the most endangered group for AOD use and related problems, are reflected within the majority of web based information contents. The large volume of AOD professionals refered to, mirror the focus on professional capacity and exchange within institutional AOD websites.

The above data about environments indicate the contexts of any AOD website subject by 15 keywords, including information about settings of prevention, treatment and research. Most frequent settings are schools (19,9%). Counting together data on dance clubs and rave scene, information about leisuretime contexts related to public dancing and music parties pertain to 18,4%. Less frequently, AOD subjects are related to workplace (10,3%), open drug scenes (7,2%), road traffic (6,9%) and sports (5,7%). Thus, the majority of web based information in the European AOD field deals with educative contexts and public dancing activities.

The formal indexation of types of web resources aims to facilitate retrieval of specific documents, in order to respond to explicit needs of professionals. It includes 45 keywords corresponding to types of publications (30), interactive services (12) and databases (3). In about 50% of the AOD websites recorded, addresses, fulltext docs and fact sheets are available. Reports (36%), bibliographies (31%) and conference calendars (24,6%) can be found frequently. Moreover, specific information such as databases (19,7%), online evaluation and tests (9%), or interactive prevention services (6%) are provided within European websites.

It is obvious that a large and still growing variety of different specific kinds of information can be found on the web, also mirrored within the AOD web landscape.

3.1.5 Data quality and consistency

In the catalogue recording process, guidelines for input were applied. Subsequently, the data has undergone an intensive edition process after entering by participants. The editorial process included the revision of data on English language correctness and proper formulation, and on correct typography. Proof-reading of the catalogue records has been performed on 2 levels to secure consistency of the catalogue content (cf. 2.2.3.3.).

During the research process, an approximate 80% majority of the data available by September 2003 has been proofread and corrected. The results are visible within the details result pages of the catalogue.

Language correctness: The English language correctness features a high quality through data for all countries. By formulations of the producer description and the website content summaries following comparable schemes, a good level of comprehensiveness has been achieved. Correction of spelling and typing errors support searchability in appropriate way. Retrieval is also supported by institutions names in original language. Due to limited resources for translation, some of the records are only available in French, which may serve French users but will be adapted in a later stage of the project.

Standardised appearance and readability: Use of standardised typographical formats within the records largely follow the guidelines of the project. The presentation of data in the default and detailed result pages have significantly profited from the typographical edition. The application of bold and italic characters for specific items in the larger text fields has proved to increase readability in high extent even for long descriptions, which is supported by the limitation of line length to a maximum of 60 characters.

Informativeness and completeness: The catalogue records provide a high level of extensiveness and quality regarding their information content. Of special benefit are the publisher descriptions and website content summaries accessible in the details result screens. From the publisher descriptions, users can learn about the activity scopes, structural contexts and political backgrounds of AOD institutions in European countries. Moreover, users can learn features and content of the website, including differentiated information on where to find which one of the various pieces of information of potential interest to professionals. Inclusion of titles of specific publications and activity programmes enhance targetted retrieval. Within its extensive metadata, the gateway is successfully facilitating access to AOD related resources.

Moreover, the invisible content of the thematic freetext entries are supporting search and retrieval for a wide range of additional and specific information that is not displayed in the result screens.

example records from the online catalogue:

example record 1 Germany

example record 2 - Finland

example record 3 France

example record 4 Czech Republic

The quality of data produced and provided is of major importance to ensure benefits for professional users, representing an essential added value of the project. Given the high level of consistency, appearance and completeness, the project has achieved its objective regarding its claim to transfer knowledge and field specific information in user-friendly way. In this context, correctness and readability mean a crucial pre-condition for the data being used. Feedbacks from external database experts and publishers confirm the good quality level of data produced in the gateway project. The assumption that users benefit from the text style and lay-out is supported by access statistics results (cf. 3.2.4).

Another central objective has been met by providing knowledge about contextual relationships and activites of European AOD institutions, which permit users to identify potential cooperation contacts across Europe even if they are not able to read the website itself, and subsequently support the initiation of contacts and networking. Therefore, results from the gateway portal are able to both support access to materials, and to serve as a communication platform.

ELISAD European Gateway on Alcohol and other Drugs / Final Research and Activity Report December 2003 
back to table of contents