Entries categorized as ‘Evaluation of communication materials’

How to instill a love for reading books

October 1, 2008 · 11 Comments

Yesterday, a reader stumbled on Devcompage and wrote a comment which struck a chord with me on the critical importance of reading among students and the need for more readable books.  Here’s her comment:

I believe that teaching history should not only focus on discussion by the teacher, it is a story that needs to be read and experienced. So, to encourage our elementary students to read History and Science, we have introduced the Cornell Method of note taking prior to discussion and experiential activity. However, our students are having difficulty reading history texts; their readability is not appropriate for age and reading skills of students. If kids are not trained early to spend time reading, all the more difficult for them to pick this habit when they are in college.  I have noticed that kids love stories; they love to read as they enjoyed perusing books when in bookstores or during fairs. But, they enjoy fiction books more than non-fiction.
So, anyone who wants to help writing Philippine history in the elementary level?

Besides a conducive reading environment in the home, books need to be readable to match age and reading skills as Luisa has pointed out.  It is also essential that books are written in a more entertaining and educational style.

How did you develop a love for reading books? Did your parents play an influential role?  How can we instill a love for reading in the younger generation?  Please post your comments.

Categories: Evaluation of communication materials · General
Tagged: , ,

How the rice crisis was presented in online news

September 25, 2008 · 1 Comment

My post on “How to do content analysis: a step-by-step guide” remains the top post of Devcompage which speaks of the demand for communication research techniques like content analysis. I can understand that because most content analysis articles are either in books or journal articles which are on a pay-per-view arrangement. Last month, my students in an evaluation of communication materials class carried out their own content analysis projects and I’d like to feature one. Here are excerpts of their report.

Online reporting of the rice crisis
by Jovelyn Cristino and Renelle Joy Tabinas

Rice crisis. Rice is the most important food commodity in the Philippines; a shortage would mean hundreds of thousands of Filipinos going hungry. Several reasons came out on what really are the root causes of the rice crisis. Among those mentioned were the high cost of inputs, lack of forward planning, and the shift to corn and jatropha. Issues about the rice crisis as being artificial was likewise cited. It was said that the country was actually facing a rice distribution crisis and that the panic was being made up by the hoarders themselves who anticipate a rise in prices. To that, conflicts across as people demanded to be told frankly by the government that there is a shortage and should also be informed about the measures that the government and the private sector are taking to lessen the shortage. The rice crisis should be addressed and taken seriously by the government before the situation gets out of hand.

Online news. Information is probably the biggest advantage the Internet is offering. The Internet is considered as the virtual trove of information. It is the fastest moving in the world. There is a huge amount of information available on the internet for just about every subject known to man ranging from government law and services, technological information, fashion, food, news, the list is endless.

Online news websites are available in the internet. News can’t just be found in newspapers anymore.  The news is even more vital because online websites can cover all manner of topics and hence news stories vary greatly on subject matter. Take for example two of the most leading online news websites in the country: Inquirer.net and gmanews.TV. With just a click of the mouse, one can search the news he or she wants to gather, rice crisis for instance.

Objectives

  1. Determine the contents of the sample issues in two online news sources
  2. Determine the factors that contribute to the crisis
  3. Analyze the frequency, placement, treatment and type of stories of each online sources

Methodology

Scope. The study dealt with rice crisis articles in the two online news sources: Inquirer.net and gmanews.TV. These sites were selected because they have the same circulation and reach and that the issues are regularly posted in each of the online sources.

The analysis focused on frequency of appearance, placement, treatment, type of stories, and content given to rice crisis articles in the site. The content was further categorized into specific areas: artificiality of the rice crisis issue, its causes, magnitude of problem, and the solutions.

Sampling procedure. All rice crisis articles posted within the time frame of one week, from March 25 to 31, 2008 were selected. It was at this time that the rice crisis issue was at its peak.

In GMANews.tv, two, three, four, two, one, one, and six articles were found on March 25-31, respectively, with a total of 19 issues.  On the other hand, Inq.net has a total of 24 articles - five for  March 25, four in March 26, two for the 27th  and 28th, one on March 29, four on March 30 and 6 articles  on March 31. A total of 43 sample issues for the two sites were chosen.

Results

Frequency of appearance. Of the 43 rice crisis-related articles in the sample issues within March 25-31, 2008, 44.4% were found in GMAnews.tv while 55.8% were posted in Inq.net. This indicates that Inquirer.net produced more rice crisis articles compared to GMAnews.tv within March 25 to 31, 2008.

Placement of rice crisis news stories. In GMANews.tv, the topmost portion of the page have clickable images and videos. The right side of the page is occupied by ads mostly on condominium units.  In Inquirer.net, it was the same with the GMAnews.tv but it has a banner at the topmost part of the page and has fewer ads.

Regarding the placement of rice crisis articles, 100% of the articles from GMAnews.tv were located in the breaking news category. This suggests that the website considered most of the rice crisis issues as important. For Inquirer.net, 41.7% were also situated in breaking news section, followed by headliners which was 20.8%. Articles in the editorial and infotech had the least percentage of rice crisis issues.

Placement of all rice crisis articles for GMAnews.tv was in breaking news because it is an online news source for television. Unlike Inquirer.net which is an online newspaper format, the articles were situated in the different locations of the site, either in headlines, column, editorial, opinion, infotech or letters to the editor.

Treatment. Both online news sources were neutral to the rice crisis issue which means that the site presented both sides of the story. GMANews.TV had 47.4% of their articles neutral while 62.5% of Inquirer.net stories were neutral. Only 15.8% and 16.7% of GMANews.TV and Inquirer.net, respectively, gave the rice crisis news a negative treatment.

Read more …

Categories: Evaluation of communication materials
Tagged: ,

How to assess celebrity endorsers and product endorsements

September 22, 2008 · No Comments

Busler’s Ph.D. thesis, Product Differentiation, Celebrity Endorsements and the Consumer’s Perception of Quality (2002), showed how he had used semantic differential  to assess consumer’s perceptions of the attributes of a product ad and the celebrity endorser.  Communication students can learn from it or adapt it in assessing advertisements. In this post, I explored how we might use Busler’s methodology to examine consumers’ perceptions of the credibility and relevance of the commercial on Alaxan FR, a pain reliever, and a world boxing champion (Manny Pacquiao) as a celebrity endorser.

A seven-point semantic differential scale can be used for each of these bipolar adjectives:

Example
Not effective  1  2  3  4  5  6  7  Effective

Concerning the credibility of the information received from the ad, I think it is:
Not credible - Very credible
Not believable - Believable
False -    True

Concerning how relevant the information in the ad would be to my buying decision, I think it is:
Not relevant - Relevant
Not important -    Important
Useless - Meaningful

Overall, I thought the Alaxan commercial was:
Ineffective - Effective
Uninformative - Informative
Dull - Interesting

I think Manny Pacquiao is:
Dishonest - Honest
Undependable - Dependable
Insincere - Sincere
Untrustworthy -    Trustworthy
Undependable -    Dependable
Unreliable - Reliable
Unqualified - Qualified
Not an expert -    Expert
Not knowledgeable - Knowledgeable

As an endorser for Alaxan I think Manny Pacquiao is:
Appropriate - Inappropriate
Ineffective - Effective

Categories: Evaluation of communication materials
Tagged: ,

How credible are celebrity endorsements of OTC drugs

September 16, 2008 · 11 Comments

Of late, there has been a flurry of celebrity endorsements of over-the-counter (OTC) drugs such as pain relievers, cough expectorants, vitamins and dietary supplements. In the Philippines, celebrity endorsers are mostly movie actors and actresses. You see a popular young movie actor sashay into your TV screen in an airport scene swearing by the power of a pain reliever that he said he had with him all the time and could not leave home without.

Based on news reports and entertainment industry buzz on the millions of dollars paid to sports celebrities like Tiger Woods and Michael Phelps, celebrity endorsement is expensive. Yet firms are willing to pay for the powerful endorsement from celebrities whose name, face and voice recognition can attract millions of consumers.

Here are the current celebrity endorses of OTC products:

Product Category

Product

Celebrity Endorser

Occupation

Pain reliever

Biogesic

John Lloyd Cruz

TV and movie actor

Advil

Edu Manzano

TV host and movie actor

Alaxan

Manny Pacquiao

World boxing champion

Cough expectorant

Solmux

Aga Muhlach

TV and movie actor

Loviscol

Maricel Soriano

TV and movie actress

itamins

Centrum

Piolo Pascual

TV and movie actor

Enervon

KC Concepcion

TV and movie actress

Myra-E

Dawn Zulueta

TV and movie actress

Haveitall

Sharon Cunera

TV and movie actress

Dietary supplements

Circulan

Anabelle Rama

Movie actress

Fitrum

Judy Ann Santos

TV and movie actress

Liveraide

Edu Manzano

TV host and movie actor

Heartvit

Kris Aquino

TV host and movie actress

Marvel Taheebo

Charlene Muhlach

TV host and movie actress

Source credibility is the most important characteristic in selecting a celebrity endorser.  Source credibility, developed by Hovland, Janis, and Kelley (1953), involves three dimensions: expertise, trustworthiness, and attractiveness.

Expertise is the perceived validity  of the assertions made by the celebrity. This connection is often made by a previous association of the person to the nature or aspect of the product. While famous athletes endorse athletic products (e.g., Olympic gold medalist Michael Phelps for Speedo, LeBron James for Nike),  Observers might say that showbiz stars could very well endorse beauty products but for over-the-counter drugs, it might be a long shot. However, if the growing number of endorsements is any indication, the ads might be bringing in the sales.

Trustworthiness is the confidence that the consumer has in the celebrity regarding honesty and objectivity. In general, people are skeptical when an unknown person, is trying to sell them something. Experts say that the more trust consumers have invested in a public figure, the less suspicious they will be about the attributes of the product being endorsed.

Attractiveness is also important in an effective celebrity endorsement. As it is a subjective dimension, perceptions of beauty depend on the market. For instance, many Asians seem to place a value on skin color which explains the popularity of skin whitening products.  Social psychologists have studied the effects of a communicator’s effectiveness on attitude change. Likewise, consumer psychologists have examined the effects of a model’s attractiveness on advertising effectiveness. Findings in both areas show that attractive models are more successful in persuading others than are less-attractive communicators and models (Chaiken, 1979, Baker & Churchill, 1977).

Are you influenced by celebrity endorsements in your purchase intentions of over-the-counter drugs? Would you go out and buy a popular pain reliever because you trust the endorser? Post your comments.

Categories: Development communication · Evaluation of communication materials
Tagged: , ,

Student’s content analysis exercise

February 13, 2008 · 5 Comments

Three weeks ago, my devcom students embarked on their content analysis exercise. To give you a flavor of my students’ initial attempt at content analysis, here’s one report:

Content analysis of 5 food websites
by Paulo-Angelo Sosmeña
BSDC-3
Introduction

Most people nowadays rely on the Internet for a variety of purposes: research,
entertainment, communication with others, etc. From the Internet we get a wide range of information on science, fashion, news and food, among others.

Filipinos are great food lovers. Not only do we eat lots of different kinds of food but we also cook them to satisfy our hungry stomachs or to impress our girlfriends. Gone are the days when food preparers rely solely on cookbooks that they borrow from friends or buy from the bookstores. Now, with just a click of the mouse, we can search for different food recipes on the Internet free of charge by downloading them and we can try them out in the kitchen afterwards.

There are many websites about food. Though they cover one major topic, food, websites differ in their features and content.

Objectives - This content analysis aims to: 1) identify the contents of 5 sample food websites, and 2) compare and contrast their features.

Procedure
1) From the Internet, five food websites were chosen, namely:
A - Joyofbaking.com
B - Allrecipes.com
C - Recipes.com
D - Cooksrecipes.com
E - Pastrywiz.com

2) Parameters were laid out to establish the scope of the content analysis: number of authors, real name or pseudonym, layout color, text and image, site copyright, clickable image, food focus, advertisements and availability of contact information.

Results
The table below reveals that 80% of the sites showed the names of the authors or team members. Some 40% have single authors while the rest is of multiple membership where members an submit their recipes, rate, and give their comments. An equal 40% each revealed their real names or pseudonyms.

Two sites have single female authors while the rest consisted of both male and female. Some 60% of the sites showed the photos of the authors and team members. Eighty percent of the sites are copyrighted; 60% combined both text and image. Another 80% have clickable images inking the reader to its recipe guide.

In terms of food focus, all of the 5 sites focuses on cakes and pastries, 60% on drinks and beverages, 60% on meat dishes, and 60% on soups and stews. Forty percent of the sites advertise baking tools and kitchen utensils while an equal number promote cookbooks.

Table 1. General features of food websites.

Parameters

Joyofbaking

Allrecipes

Recipes

Cooksrecipes

Pastrywiz

Layout color

brown & gray

yellow & orange

green

white & blue

blue

Text and image

combination text & image

combination text & image

too textual, less image

too textual, less image

combination text & image

Site copyright

yes

yes

no

yes

yes

Clickable image

yes

yes

yes

no

yes

Number of authors

single

multiple

multiple

single

single

Author/member image

available

available

not available

not available

available

Name type

real name

pseudonym

pseudonym

real name

real name

Gender

female

male & female

male & female

female

female

Availability of contact info

yes

yes

no

yes

yes

Categories: Evaluation of communication materials
Tagged:

Audience research - what, why and how?

January 25, 2008 · 4 Comments

Can Tho University (Vietnam) students on their way to conduct a farmer survey in Vinh Thanh district

Next week, our DC 132 class will design their own audience research projects. Their assignment over the weekend is to think about a topic that they are passionate about. Here are some ideas I got from the class on possible audience analysis topics:

  • Students’ feedback to the university student publication - frequency of issue, editorial staff, content (writing style, choice of topics, grammar, etc.), page size, cover design, etc.
  • Listenership and impact of the university’s rural educational radio station – who listens to it, how many listen to it, audience demographics, what is done with information received, adoption and adaptation, and impact — changes in household and farm enterprises, livelihood, productivity and profitability
  • Internet usage of university students
  • Students’ information acquisition patterns – information sources for school work (library, Internet, both), Internet usage – frequency, number of hours spent, where Internet use done, type of Internet activities engaged in (email, blogging, seeking general information, surfing, chat rooms, websites frequently visited, etc.)
  • Gender differences in news media exposure
  • Current news awareness and news media exposure of high school and college students
  • Viewership of “fantaseryes” among grade school children

What is audience research?
Audience research is any communication research that is conducted on specific audience segments to gather information about their demographics, media habits, needs, attitudes, knowledge, interests, preferences, or behaviors.

Why conduct audience research?
Audience research is undertaken at the initial stages of a communication campaign to understand the intended audience’s needs, knowledge, attitudes and behaviors, barriers or constraints to a recommended basket of options. At this stage, information is also obtained on audience preferences for communication channels or formats and usage frequency and schedule. Audience analysis enables the communication planner to determine the types of incentives and barriers that the audience perceive to exist, their most preferred channels or formats, the most credible sources, segment an audience into groups with similar information needs and preferences, select the objectives most appropriate for an audience, select the best media channels to reach an audience, develop concepts or messages to achieve the communications objectives and plan for communication impact assessment.

Audience research methods
Also referred to as market research or formative research, audience analysis involves the use of focus group discussions, literature and document reviews, community consultations, rapid rural appraisals, scoping studies, and knowledge-attitude-practice (KAP) surveys. While focusing on the key issues to be addressed by the communication program, audience research variables largely include population size and distribution, language spoken, literacy and educational levels, socio-cultural factors, economic indicators, health indicators, psychographics, and other variables.

How to conduct an audience analysis survey

Because the cost of implementing surveys is often high, it is important that they are planned and conducted with utmost care. Audience analysis surveys follow the standard survey methodology described in social science textbooks. A summary of these steps is presented below:

1. Identify the problem or issues to be addressed by the survey.

2. Formulate survey objectives

The survey objective might be to determine the media habits and perceptions, knowledge, and practices in environmental protection of farm families. Drawing up a list of variables that will help find answers to the survey objectives could put the researcher on the right track in designing the questions to ask in the survey. Specific questions that are aimed at various aspects of the problem could help clarify the research problem.

3. Develop the survey instrument

In a survey, a popular instrument used for data collection is a questionnaire which contains a series of questions designed to gather information from the respondents. The survey questionnaire may contain questions on the demographics of respondents, their communication access and exposure, knowledge, attitude and practice questions on an identified problem, among others.

4. Pretest the questionnaire

When the survey questionnaire has been compiled, it needs to be translated into the local language and pretested before being reproduced and used in the field. Pretesting involves interviewing a small group of respondents who are similar to the intended target group to determine their reactions to the prototype questionnaire. The pretest is a screening of the questionnaire to see how it works and whether changes are necessary before the start of the actual survey.

5. Choose sample respondents

An important concern in survey research is deciding how many and which respondents should be included. An audience analysis survey uses standard social science methods in selecting the sample, e.g., multi-stage sampling, stratified sampling, systematic sampling, cluster sampling, and simple random sampling. The choice of sampling technique depends primarily on the nature of the problem, the cost and time factors involved, and the desired precision or reliability of the results. It is recommended that the sample be drawn from a cross-section of the sampling population so that this group can be said to represent the larger population.

6. Implement the field survey

When the questionnaire has been pretested, finalized and reproduced, the next step is to implement the field survey. Before they are fielded, interviewers are oriented on the purpose of the survey and trained on interviewing skills and how to conduct the interviews. Guided by the sampling plan and respondent list, the interviewers locate the respondents, conduct the interviews, and check the completed questionnaires after the interview.

7. Coding and analyzing survey data

Once the completed questionnaires have been edited, the data need to be analyzed. Depending on the main objective of the survey, this analysis phase can be relatively simple – such as manually determining the % of respondents giving specific answers or listing the various ways in which farmers said they might utilize a new practice. For more complex surveys, particularly where the aim is to predict for the entire population from the results of the sample population, it is best that the data are encoded, processed and analyzed using a statistical package. Ease of use, power, and cost are some of the important considerations in the choice of computer software for data analysis.

8. Write the survey report

The analyzed data are interpreted and the results of this interpretative process are reported. The purpose of a survey report is to tell the readers the research problem, data collection methods used, findings, and conclusions. Like other research reports, the survey report should consist of an executive summary, introduction, description of the methods, results and discussion, and conclusions.

For a sample audience analysis report, click here …

Categories: Evaluation of communication materials
Tagged: , , , , , ,

How to do content analysis: a step-by-step guide

January 17, 2008 · 12 Comments

As there are tests to assess the readability of food recipes from celebrity chefs, there are also techniques to determine the themes, dominant patterns, portrayal, and treatment of specific issues in newspapers, comics, TV and radio programs, posters, and even the new media such as websites and weblogs.

My undergrad DC132 class will carry out their individual content analysis projects and I came up with a simplified procedure to make their first foray into the world of content analysis easier. A short content analysis project can be done on any of these topics: 1) portrayal of women, children, alcoholism, smoking in films; 2) weekend commercial load on primetime of a leading TV station; 3) treatment of governance, corruption, environmental issues, health, economics, tourism, etc. in one week consecutive issues of a leading national newspaper; 4) structure and content of blogs (food, travel, politics, students, etc.). Here’s the procedure:

Step 1 - State your research question - or what do you want to find out?1.1 What are the structural characteristics and content of ______ blogs (student, food, travel, homemaking, political, etc.)?

1.2 How are environmental issues covered and treated in a major national broadsheet?
1.3 How is ________ (alcoholism, smoking, homosexuality, children, women) portrayed in primetime TV programs?
1.4 What types of news stories are prevalent in the early and late evening TV news?
1.5 What percentage of primetime TV news is … crime, accidents, graft and corruption, development issues?
1.6 What is the match between audience and type of commercials aired on primetime TV?
1.7 How are ________ (women, children, smoking, alcoholism) portrayed in films?

Step 2 - Outline your research plan to gather the information. Describe how you will observe, categorize, record and quantify your observations.

A constructed calendar will facilitate your sampling procedure. Prepare 7 boxes with each box representing the days of the week. On slips of paper, write the dates of all days of the week in one month and place them in separate boxes. Thus, there will be a Monday box, a Tuesday box, and so on. This is done to ensure that each day of the week is represented in your study. Depending on the sample size you have decided on (say, 35% of a year’s issues), randomly pick 2 to 4 slips from each box until you have drawn the required sample issues. Mark the sampled dates on a calendar to guide you in selecting the issues to be analyzed. In the sample constructed calendar below, the sample dates (in boldface) are January 2, 14, 25 and 29 representing a Monday, Tuesday, Wednesday and Friday.

January 2008

Sun

Mon Tue Wed Thu Fri Sat
1 2 3 4 5
6 7 8 9 10 11 12
13 14 15 16 17 18 19
20 21 22 23 24 25 26
27 28 29 30 31

Step 3 - Gather and analyze the data
Step 4 - Write up your findings — in tables, charts and text

For specific procedures …

Categories: Evaluation of communication materials
Tagged: , , , , ,

How readable are food recipes?

January 15, 2008 · 3 Comments

Espasol - a native delicacy made of toasted gluttinous rice flour

In my other blog, placesandfood, I share some of my own recipes with readers, particularly the recipe for espasol (pictured above) which took me many years to perfect. In that blog, I often talk about the human interest side of the recipe, like where to buy the best espasol, where to get the ingredients, where to have the toasted sticky rice milled or where I started cooking it. Yet, I haven’t really explored if the measurements and procedure are easy to understand to blog readers out there.

Before the year 2007 ended, our DC132 class discussed the various readability formulas and calculated the reading ease of sample materials using the Flesch formula, Gunning’s Fog Index, SMOG test, and the cloze procedure. These readability tests illuminated some rules about how to make our prose understandable: use simple words, avoid polysyllables, and use shorter sentences.

Well, what do you know? Just as I was about to start a series of posts on a step-by-step guide to content analysis for my DC132 students, I stumbled on an interesting report published in UK’s Telegraph. The study, conducted by the Department of Innovation, Universities and Skills, examined the readability of recipes of popular celebrity chefs. The research was carried out to highlight the Government’s adult learning campaign.

The study assessed 35 recipes published by five of the most popular celebrity chefs and assessed their readability and writing style. Female celebrity chefs, who used complex language in their cookbooks, appeared to be harder to understand in print than their male counterparts. The report noted that Gordon Ramsay’s language is so easy to read that his cooking methods could be followed by a seven-year-old. Similarly Nigel Slater, whose book The 30-Minute Cook is a best-seller, writes instructions that a child of 11 would have no problems comprehending.

However, more than 5.3 million adults would not be able to understand Nigella Lawson’s instructions as her writing style is too “chatty” and she uses long sentences.

The report confirmed what readability tests have long pointed out — that in order to understand the long sentences, complex measurements and complicated words, one must have GCSE standard reading and numeracy skills

Read more …

Categories: Evaluation of communication materials
Tagged: ,

Content analysis: what and how

December 20, 2007 · 8 Comments

In the early 70s, two biographies of the most powerful woman of the land hit the book shops in Manila. One was a commissioned coffee-table type book written by an award-winning writer while the other became a best-selling paperback written by a journalist. The “iron butterfly”, apparently miffed by the paperback’s detailed account of her humble beginnings, invited our dean to the palace to ask her to do a content analysis of those two biographies. She wanted the content analysis to reveal the motives of the writers, particularly the one who wrote, The Untold Story of … so that appropriate action might be taken against her. Our dean and two colleagues carried out the project as requested but in their report, they emphasized that content analysis, as defined, only deals with manifest content and not latent ones. After that content analysis project, the rest was history. The author of the explosive paperback eventually went on exile in London.

So what is content analysis? Berelson provided a classic definition of content analysis as a research technique for the objective, systematic, and quantitative description of the manifest content of communication. Ole Holsti (1969) defined content analysis as “any technique for making inferences by objectively and systematically identifying specified characteristics of messages.”

The key to understanding content analysis and performing it competently lies in understanding the meaning of objective, systematic, quantitative, and manifest content.

Objectivity is achieved by having the categories of analysis defined so precisely that different persons can apply them to the same content and get the same results. If content analysis were subjective instead of objective, each person would have his own content analysis. That it is objective means that the results depend upon the procedure and not the analyst.

Systematic means, first, that a set procedure is applied in the same way to all the content being analyzed. Second, it means that categories are set up so that all relevant content is analyzed. Finally, it means that the analyses are designed to secure data relevant to a research question or hypothesis.

Quantitative means simply the recording of numerical values or the frequencies with which the various defined types of content occur.

Manifest content means the apparent content, which means that content must be coded as it appears rather than as the content analyst feels it is intended.

Content analysis procedure

1. Determine the universe of the content to be analyzed (newspapers, books, magazines, letters, radio scripts, radio tapes, comics, film, video tapes, songs, etc.).

2. Obtain the sample to be analyzed.

3. Code the data. Specify the unit of analysis. There are 5 major recording units of analysis: single word or symbol, theme, character, sentence or paragraph, and item (entire article, etc.)

4. Decide on the system of enumeration or quantification. Methods of measurement include:
1) space - measures column inches or column centimeter in print materials
2) time - measures duration or length of time in audio and video materials, e.g., radio, TV, film, video tape
3) presence or absence of the content unit
4) frequency count in which every occurrence of the content units is counted

Read more …

Categories: Evaluation of communication materials
Tagged: , , , , ,

Semantic differential

December 17, 2007 · No Comments

Semantic differential is a type of a rating scale designed to measure the connotative meaning of objects, events, and concepts or attitudes. It has been used for a variety of purposes ranging from predicting a political election to identifying changes in personality structure. Charles Osgood’s semantic differential was designed to measure the connotative meaning of concepts. The respondent is asked to choose where his or her position lies, on a scale between two bipolar words, or a range of words or numbers ranging across a bipolar position (for example, `Excellent’, `Good’, Adequate’, `Poor’, `Inadequate’; or from 5 (powerful) down to 1 (weak).

Semantic differentiation is a procedure that involves rather standard scaling practices and a variety of analytical methods. The critical attributes of a semantic differential seem to be bipolar adjectives on seven-point scales like the ones below. The concepts are selected according to the researcher’s interest. The scales may be specially constructed for a particular task or selected from existing sets by any of several criteria. Differences in the patterns of check marks on the scales are assumed to represent differences in meanings of the concepts judged and/or differences in groups of subjects judging the same concepts.

Applying the semantic differential to rate a blog or website

You can apply the semantic differential to rate our blog, Devcompage. Example: Would you say our blog (Devcompage) is:

Up-to-date ____ ____ ____ ____ ____ ____ ____ Obsolete
Well-organized ____ ____ ____ ____ ____ ____ ____ Cluttered
Attractive ____ ____ ____ ____ ____ ____ ____ Unattractive
Very useful ____ ____ ____ ____ ____ ____ ____ Very useless
Interactive ____ ____ ____ ____ ____ ____ ____ Static
Compelling ____ ____ ____ ____ ____ ____ ____ Unconvincing
Trustworthy ____ ____ ____ ____ ____ ____ ____ Doubtful
Reliable ____ ____ ____ ____ ____ ____ ____ Suspicious
Relevant ____ ____ ____ ____ ____ ____ ____ Irrelevant

If you can think of other attributes of an excellent blog that can be added to the rating scale above, please drop your comments to this post.

Read more …

Categories: Evaluation of communication materials
Tagged: , ,